-- Logs begin at Wed 2022-01-19 15:45:27 UTC, end at Wed 2022-01-19 17:08:15 UTC. -- Jan 19 16:15:58.336379 dv-cinder-784477-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 16:15:58.345055 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 16:15:58 2022] *** Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: nodename: dv-cinder-784477-14-iscsi Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: machine: x86_64 Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: clock source: unix Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: pcre jit disabled Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: detected number of CPU cores: 4 Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: current working directory: / Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: detected binary path: /usr/bin/uwsgi-core Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: your processes number limit is 47680 Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: your memory page size is 4096 bytes Jan 19 16:15:58.347120 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: detected max file descriptor number: 2048 Jan 19 16:15:58.348699 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: lock engine: pthread robust mutexes Jan 19 16:15:58.348699 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: thunder lock: enabled Jan 19 16:15:58.348699 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 16:15:58.348699 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 16:15:58.391845 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: Python main interpreter initialized at 0x55cf5be7d9c0 Jan 19 16:15:58.391845 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: python threads support enabled Jan 19 16:15:58.391845 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: your server socket listen backlog is limited to 100 connections Jan 19 16:15:58.391845 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: your mercy for graceful operations on workers is 90 seconds Jan 19 16:15:58.392247 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 16:15:58.392247 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: *** Operational MODE: preforking *** Jan 19 16:15:58.392524 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: *** uWSGI is running in multiple interpreter mode *** Jan 19 16:15:58.392524 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: spawned uWSGI master process (pid: 101777) Jan 19 16:15:58.392738 dv-cinder-784477-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 16:15:58.395706 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: spawned uWSGI worker 1 (pid: 101778, cores: 1) Jan 19 16:15:58.395706 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: spawned uWSGI worker 2 (pid: 101779, cores: 1) Jan 19 16:15:58.395706 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 16:16:00.177214 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:16:00.177214 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: from cryptography.utils import int_from_bytes Jan 19 16:16:00.177885 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:16:00.177885 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: from cryptography.utils import int_from_bytes Jan 19 16:16:00.184520 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:16:00.184520 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Jan 19 16:16:00.185022 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:16:00.185022 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Jan 19 16:16:02.806328 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 16:16:02.806852 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 16:16:02.807071 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 16:16:02.807436 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 16:16:02.807704 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 16:16:02.808106 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.808428 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.808749 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.809072 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.809400 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.809710 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.810029 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.810346 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.810678 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.810934 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.811254 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.811577 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-14-iscsi {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.811924 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.812231 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.812541 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.812633 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 16:16:02.812990 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 16:16:02.813071 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.813236 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.813374 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 16:16:02.813468 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.813668 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 16:16:02.813771 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.813916 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 16:16:02.814243 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.814636 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.814636 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.814877 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.814994 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.815110 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.815228 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.815344 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.815519 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.815727 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.815892 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.815985 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.816263 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.816857 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.817050 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.817164 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.817378 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.817480 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.817639 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.817738 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.817953 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.818097 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.818270 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-14-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.818360 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-14-iscsi {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.818593 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.818701 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.818897 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.819004 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.819207 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.819316 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.819516 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.819700 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.819842 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.820006 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.820161 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.820298 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.820473 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821189 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821189 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821372 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821464 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821553 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821633 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821724 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821847 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.821932 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.822164 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.822253 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.822476 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.822562 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.822777 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.822862 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.823089 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.823192 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.823394 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.823530 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.823733 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.823822 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.824042 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.824140 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.824347 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.824433 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-14-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.824597 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.824730 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.824905 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.825041 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.825226 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.825357 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.825547 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.825745 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.825866 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.826055 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.826141 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.826352 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.826445 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.826665 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.826750 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.826983 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.827068 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.827290 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.827389 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.827595 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.827706 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.827933 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.828038 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.828237 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.828352 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.828543 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.828733 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.828868 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.828961 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.829138 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.829229 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.829442 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.829529 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.829758 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.829857 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830060 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830147 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830364 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830470 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830610 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830707 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830914 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.830990 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.832114 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.832256 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.832433 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.832552 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.832660 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.832776 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.832889 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833002 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833118 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833234 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833359 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833465 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833569 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833684 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833799 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.833924 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834055 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834142 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834221 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834315 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834397 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834482 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834562 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834666 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.834753 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835000 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835088 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835305 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835390 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835564 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835665 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835880 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.835968 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.836187 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.836277 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.836503 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.836605 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.836809 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.836903 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.837114 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.837222 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.837418 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.837514 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.837717 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.837804 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.838023 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.838117 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.838329 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.838425 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.838633 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.838726 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.838937 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.839023 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.839239 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.839414 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.839561 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.839653 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.839873 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.839963 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.840178 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.840278 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.840480 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.840574 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.840796 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.840889 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.841096 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.841192 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.841345 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.841438 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.841643 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.841729 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.841947 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.842042 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.842266 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.842363 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.842567 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.842662 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.842870 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.842974 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.843173 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.843263 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.843470 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.843583 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.843799 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.843901 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.844135 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.844233 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.844402 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.844486 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.844708 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.844830 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845005 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845098 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845305 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845398 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845603 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845710 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845901 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.845994 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.846203 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.846356 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.846492 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.846624 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.846801 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.846946 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.847114 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.847325 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.847462 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.847613 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.847803 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.847949 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.848102 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.848255 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.848398 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.848550 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.848694 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.848836 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.848965 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.849110 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.849252 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.849389 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.849538 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.849676 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.849823 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.849979 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.850132 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.850270 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.850411 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.850568 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.850689 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.850820 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.850955 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.851096 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.851271 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.851407 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.851564 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.851749 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.851887 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.852021 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.852174 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.852311 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.852466 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.852611 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.852742 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.852879 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.853051 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.853189 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.853343 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.853494 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.853637 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.853773 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.853913 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.854062 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.854245 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.854449 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.854593 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.854731 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.854879 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.855031 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.855170 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.855313 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.855449 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.855591 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.855791 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.855951 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.856093 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.856247 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.856399 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:16:02.856537 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.856666 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.856806 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.856948 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.857080 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.857251 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.857400 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.857545 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.857693 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.857875 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.858006 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.858203 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.858349 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.858519 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.858687 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.858827 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.859002 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.859137 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.859326 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.859463 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.859634 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.859801 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.859972 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.860112 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.860286 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.860421 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.860598 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.860736 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.860910 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.861052 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.861240 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.861379 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.861553 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.861695 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.861867 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.862008 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.862204 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.862323 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.862522 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.862631 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.862844 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.863470 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.863694 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.863825 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.864006 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.864150 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.864388 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.864489 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.864623 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.864787 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.864926 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.865126 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.865246 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.865438 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.865571 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.865759 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.865878 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.866067 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.866210 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.866387 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.866515 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.866697 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.866824 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.867011 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.867133 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.867980 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.868106 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.868191 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.868259 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.869123 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.869256 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.869353 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.869436 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.869525 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.869607 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.870455 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.870567 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.870661 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.870806 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.870899 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.870979 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871059 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871146 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871224 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871312 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871393 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871466 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871578 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871664 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871768 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871838 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871913 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.871979 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872051 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872127 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872208 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872276 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872349 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872422 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872495 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872643 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872773 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.872914 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.873037 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.873220 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.873346 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.873549 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.873638 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.873874 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.873961 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.874190 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.874280 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.874500 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.874601 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.874804 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.874892 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.875110 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.875207 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.875411 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.875505 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.875733 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.875825 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.876045 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.876153 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.876349 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.876435 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.876651 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.876776 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.876957 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.877054 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.877261 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.877355 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.877564 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.877658 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.877868 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.877962 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.878181 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.878265 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.878483 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.878604 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.878842 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.878980 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.879146 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.879307 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.879491 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.879631 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.879820 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.879970 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.880163 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.880294 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.880498 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.880585 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.880818 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.880906 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.881142 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.881227 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.881443 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.881537 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.881752 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.881839 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.882054 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.882146 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.882356 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.882452 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.882660 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.882747 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.882962 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.883049 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.883263 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.883363 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.883584 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.883709 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.883916 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.884003 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.884220 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.884317 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.884523 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.884665 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.885331 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.885421 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.885655 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.885752 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.885961 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.886054 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.886275 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.886367 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.886613 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.886700 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.886926 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.887012 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.887247 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.887339 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.887583 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.887697 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.887892 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.888534 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.888629 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.888698 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.888775 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.889389 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.889491 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.889580 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.889670 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.889752 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.889912 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890142 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890235 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890406 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890504 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890586 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890680 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890763 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890842 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.890909 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891130 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891237 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891307 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891380 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891487 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891617 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891811 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.891916 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.892127 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.892215 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.892458 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.892546 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893353 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893472 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893584 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893669 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893756 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893837 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893903 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.893978 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.894058 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.894149 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.894373 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.894459 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.894688 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.894818 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.894995 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.895105 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.895303 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.895390 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.895611 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.895767 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.895950 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.896036 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.896255 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.903770 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.903770 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.903953 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904036 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904116 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904227 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904312 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904402 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904483 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904569 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904650 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904725 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904817 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.904949 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905038 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905119 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905197 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905275 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905385 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905476 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905557 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905636 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905716 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905795 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905882 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.905964 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906044 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906129 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906209 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906288 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906375 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906483 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906574 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906655 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906734 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906819 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906908 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.906989 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907068 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907154 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907224 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907298 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907373 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907440 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907543 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907543 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.907975 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908069 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908152 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908231 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908309 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908387 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908464 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908551 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908632 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908710 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908788 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908879 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.908960 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909048 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909129 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909207 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909284 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909362 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909453 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909523 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909588 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909652 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909717 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909807 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909900 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.909981 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910059 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910137 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910223 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910223 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910433 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910556 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910653 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910734 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910820 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910908 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910997 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.910997 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911149 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911231 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911310 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911396 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911485 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911572 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911652 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911752 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911831 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.911924 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912006 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912084 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912169 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912250 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912328 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912419 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912419 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912572 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912572 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912716 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912801 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912890 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.912978 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913066 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913146 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913224 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913312 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913393 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913607 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913694 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913910 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.913995 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.914212 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.914299 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.914521 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.914784 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.914871 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.915113 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.915207 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.915427 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.915513 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.915768 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.915861 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.916084 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.916249 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.916390 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.916479 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.916700 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.916839 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.917003 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.917097 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.917325 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.917419 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.917668 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.917811 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.917927 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.918025 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.918228 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.918318 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.918529 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.918614 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.918833 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.918929 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.919136 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.919224 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.919438 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.919524 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.919761 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.919869 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.920071 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.920158 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.920373 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.920467 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.920675 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.920771 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.921003 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.921089 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.921306 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.921403 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.921617 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.921705 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.921918 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.922020 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.922223 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.922308 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.922524 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.922611 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.922824 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.922911 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.923134 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.923229 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.923432 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.923526 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.923756 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.923860 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.924059 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.924146 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.924358 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.924454 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.924667 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.924754 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.924970 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.925058 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.925282 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.925901 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.926138 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.926233 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.926445 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.926533 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.926749 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.926837 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.927060 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.927149 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.927367 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.927491 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.927686 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.927776 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.927996 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.928082 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.928299 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.928421 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.928604 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.928691 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.928904 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.928991 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.929207 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.929292 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.929513 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.929601 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.929818 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.929909 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.930124 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.930218 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.930424 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.930509 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.930805 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.930913 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.931034 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.931130 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.931337 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.931422 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.931640 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.931819 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.931964 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.932063 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.932265 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.932358 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.932567 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.932662 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.932869 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.933012 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.933170 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.933260 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.933475 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.933563 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.933776 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.933864 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.934086 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.934172 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.934386 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.934478 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.934687 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.934773 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.934985 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.935070 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.935288 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.935374 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.935589 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.935695 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.935912 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.936009 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.936211 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.936298 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.936515 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.936609 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.936815 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.936900 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.937114 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.937200 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.937419 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.937514 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.937715 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.937801 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.938013 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.938107 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.938311 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.938404 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.938627 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.938713 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.938939 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.939032 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.939236 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.939321 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.939565 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.939666 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.939871 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.939972 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.940174 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.940269 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.940475 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.940645 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.940780 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.940976 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.941695 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.941797 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.941967 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.942054 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.942267 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.942355 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.942571 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.942657 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.942873 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.942960 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.943178 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.943264 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.943485 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.943576 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.943806 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.943895 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.944109 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.944198 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.944409 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.944505 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.944744 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.944837 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.945044 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.945137 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.945379 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.945464 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.945686 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.945782 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.945994 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.946079 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.946302 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.946387 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.946608 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.946703 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.946916 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.947001 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.947225 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.947319 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.947528 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.947623 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.947866 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.947955 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.948176 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.948262 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.948486 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.948584 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.948786 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.948871 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.949087 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.949187 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.949396 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.949489 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.949703 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.949796 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.950006 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.950092 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.950321 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.950407 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.950628 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.950713 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.950935 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.951022 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.951253 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.951393 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.951540 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.951627 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.951869 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.951956 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.952174 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.952251 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.952477 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.952609 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.952781 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.952922 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.953086 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.953233 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.953392 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.953540 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.953698 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.953856 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.954003 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.954168 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.954309 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.954485 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.954610 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.954803 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.954916 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.955109 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.955219 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.955521 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.955607 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.955865 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.955955 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.956172 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.956272 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.956474 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.956570 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.956826 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.956917 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.957127 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.957216 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.957433 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.957529 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.957738 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.957825 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.958046 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.958166 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.958354 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.958461 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.958660 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.958768 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.958984 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.959071 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.959290 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.959392 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.959613 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.959740 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.959987 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.960080 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.960300 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.960378 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.960603 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.960686 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.961012 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.961088 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.961321 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.961405 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.961663 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.961761 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.961938 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.962015 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.962239 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.962327 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.962539 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.963580 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.963716 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.963845 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.963943 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964026 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964113 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964202 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964282 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964371 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964453 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964532 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964610 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964691 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964770 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964862 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.964945 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.965025 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.965334 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.965423 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.965643 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.965740 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.965944 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.966039 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.966265 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.966342 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.966649 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.966738 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.966959 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.967054 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.967281 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.967374 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.967606 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.967802 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.967952 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.968093 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.968256 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.968344 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.968571 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.968667 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.968880 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.968968 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.969189 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.969274 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.969501 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.969597 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.969806 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.969902 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.970116 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.970211 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.970416 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.970513 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.970726 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.970812 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.971040 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.971135 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.971348 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.971436 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.971651 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.971788 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.971998 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.972166 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.972380 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.972521 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.972708 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.972800 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.973025 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.973121 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.973562 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.973685 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.974404 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.974513 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.974598 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.974678 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.974757 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.974846 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.974928 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975007 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975095 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975177 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975257 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975345 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975451 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975556 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975780 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.975886 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.976092 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.976207 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.976398 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.976491 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.976697 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.976842 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.976992 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.977133 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.977306 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.977444 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.977607 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.977709 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.977923 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.978011 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.978233 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.978320 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.978550 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.978635 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.978865 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.978960 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.979165 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.979251 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.979481 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.979601 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.979810 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.979901 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.980113 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.980198 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.980413 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.980509 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.980715 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.980801 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.981020 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.981104 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.981321 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.981453 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.981623 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.981735 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.981928 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.982031 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.982246 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.982344 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.982550 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.982637 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.982873 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.982967 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.983182 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.983270 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.983485 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.983573 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.983812 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.983906 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.984126 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.984229 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.984425 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.984511 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.984725 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.984812 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.985031 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.985119 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.985332 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.985426 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.985633 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.985733 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.985933 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.986028 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.986237 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.986331 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.986534 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.986630 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.986833 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.986921 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.987130 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.987218 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.987451 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.987546 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.987775 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.987865 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.988630 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.988733 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.988936 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.989053 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.989291 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.989393 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.989539 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.989635 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.989839 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.989941 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.990239 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.990341 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.990478 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.990566 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.990809 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.991054 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.991997 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992068 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992150 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992234 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992317 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992399 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992478 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992557 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992624 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992702 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992779 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.992922 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.993053 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.993238 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.993348 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.993549 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.993647 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.993858 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.993953 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.994167 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.994263 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.994477 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.994571 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.994784 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.994870 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.995096 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.995183 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.995407 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.995496 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.995766 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.995944 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.996075 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.996387 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.996485 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.996700 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.996813 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.997056 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.997148 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.997373 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.997462 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.997682 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.997769 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.997996 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.998084 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.998313 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.998400 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.998619 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.998707 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.998926 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.999013 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.999233 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.999322 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.999539 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.999626 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.999876 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:02.999968 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.000190 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.000267 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.000501 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.000576 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.000818 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.000904 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.001129 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.001204 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.001442 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.001517 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.001754 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.001838 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.002065 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.002141 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.002383 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.002458 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.002698 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.002801 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.003021 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.003142 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.003336 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.003632 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.003815 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.003938 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.004134 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.004275 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.004446 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005014 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005109 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005179 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005288 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005372 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005452 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005751 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.005860 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006056 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006193 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006284 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006365 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006454 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006536 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006718 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.006844 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.007028 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.007178 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.007845 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.008054 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.008177 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.008371 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.008489 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.008778 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.008868 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.009098 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.009185 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.009406 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.009640 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.009934 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.010034 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.010268 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.010367 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.010581 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.010669 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.010901 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.010990 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.011217 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.011304 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.011531 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.011648 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.011868 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.011973 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.012180 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.012266 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.012485 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.012588 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.012790 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.012889 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.013104 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.013249 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.013401 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.013565 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.013704 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.013799 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.014010 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.014099 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.014310 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.014407 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.014624 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.014712 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.014928 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.015026 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.015237 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.015453 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.015542 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.015876 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.015967 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.016185 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.016323 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.016490 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.016578 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.016794 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.016881 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.017104 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.017201 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.017407 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.017502 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.017710 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.017796 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.018013 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.018119 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.018317 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.018408 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.018626 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.018718 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.018927 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.019017 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.019252 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.019351 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.019642 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.019797 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.019901 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.019985 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.020188 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.020277 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.020490 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.020577 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.020797 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.020887 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.021098 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.021194 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.021407 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.021493 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.021710 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.021799 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.022011 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.022105 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.022314 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.022411 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.022624 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.022710 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.022926 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.023014 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.023228 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.023370 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.023532 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.023620 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.023858 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.023958 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.024168 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.024415 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.024505 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.024765 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.024851 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.025066 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.025154 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.025374 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.025463 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.025678 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.025763 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.025986 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.026083 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.026289 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.026365 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.026608 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.026684 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.026911 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.027000 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.027211 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.027338 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.027519 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.027596 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.027849 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.027942 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.028161 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.028237 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.028472 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.028569 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.028779 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.028875 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.029084 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.029167 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.029393 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.029480 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.029702 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.029940 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.030017 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.030309 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.030392 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.030633 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.030717 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.030957 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.031031 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.031275 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.031361 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.031578 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.031661 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.031907 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.031994 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.032214 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.032301 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.032523 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.032610 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.033084 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.033171 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.033388 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.033475 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.033694 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.033788 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.034000 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.034089 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.034306 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.034394 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.034614 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.034700 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.034943 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.035067 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.035250 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.035383 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.035568 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.035720 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.035888 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.036044 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.036201 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.036357 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.036539 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.036678 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.036856 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.037003 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.037170 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.037317 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.037484 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.037636 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.037798 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.037945 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.038111 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.038271 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.038417 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.038609 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.038727 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.038934 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.039031 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.039259 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.039347 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.039564 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.039660 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.039893 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.039995 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.040201 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.040290 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.040511 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.040661 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.040841 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.040972 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.041172 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.041289 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.041486 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.041604 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.041808 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.041905 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.042121 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.042216 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.042442 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.042530 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.042750 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.042846 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.043070 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.043157 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.043391 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.043520 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.043723 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.043816 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.044038 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.044134 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.044371 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.044477 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.044689 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.044777 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.044989 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.045063 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.045292 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.045377 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.045593 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.045670 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.045899 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.045974 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.046208 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.046292 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.046535 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.046611 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.046844 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.046942 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.047155 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.047233 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.047463 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.047545 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.047807 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.047887 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.048119 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.048197 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.048438 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.048520 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.048749 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.048826 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.049058 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.049142 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.049364 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.049441 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.049679 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.049754 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.049989 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.050079 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.050298 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.050900 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.051132 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.051235 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.051439 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.051535 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.051769 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.051874 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.052080 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.052177 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.052405 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.052493 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.052728 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.052823 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.053030 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.053126 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.053350 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.053438 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.053664 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.053762 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.053976 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.054065 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.054288 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.054376 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.054596 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.054682 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.054902 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.054990 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.055151 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 16:16:03.055240 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.055515 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.055844 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.056155 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.056470 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.056780 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.057104 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.057427 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.057749 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.058071 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.058414 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.058730 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.059070 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.059394 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.059736 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.060042 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.060345 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:16:03.060585 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 16:16:03.079363 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.085399 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.151148 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.context [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64672888-0d64-4da8-bffb-e5ab20f1eacc(cell1) {{(pid=101779) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 16:16:03.155415 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:03.156989 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.context [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64672888-0d64-4da8-bffb-e5ab20f1eacc(cell1) {{(pid=101778) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 16:16:03.157093 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:03.158171 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:03.160656 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:03.162006 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:03.163578 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:03.164721 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:16:03.166669 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:16:03.171158 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.173760 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.181152 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.184280 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.334265 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.346008 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:16:03.677794 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:16:03.680398 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:16:03.684529 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:16:03.687083 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:16:04.025903 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:16:04.028459 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:16:04.031054 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:16:04.034035 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:16:04.036650 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf5be7d9c0 pid: 101779 (default app) Jan 19 16:16:04.038687 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:16:04.039288 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf5be7d9c0 pid: 101778 (default app) Jan 19 16:16:04.039873 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-d61cba53-6250-429b-8a8f-23e327bf6b58 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Jan 19 16:16:04.040282 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Jan 19 16:16:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:35.785366 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:35.787143 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002745 Jan 19 16:17:35.787772 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:36.508247 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-74e3483b-867a-46b7-ae7c-edb47dcfcfb1 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:36.553650 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-74e3483b-867a-46b7-ae7c-edb47dcfcfb1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.756469 Jan 19 16:17:36.554491 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jan 19 16:17:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:38.915983 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:38.917077 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-d983015c-9721-40b5-8e74-899d7b2a9590 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jan 19 16:17:38.917720 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:38.980295 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-6c8b89e2-6a34-42b7-bebf-286d1c1527dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:38.999278 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:17:38.999278 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 19 16:17:39.031534 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-6c8b89e2-6a34-42b7-bebf-286d1c1527dd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106430 Jan 19 16:17:39.032409 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:17:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:17:39.250274 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-b79b53c2-dc7a-48cd-8f2b-35cd905d963a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:39.252779 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:17:39.252779 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Jan 19 16:17:39.309487 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-b79b53c2-dc7a-48cd-8f2b-35cd905d963a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.268899 Jan 19 16:17:39.310745 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jan 19 16:17:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:17:41.716501 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-6c8b89e2-6a34-42b7-bebf-286d1c1527dd admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:41.717875 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-6c8b89e2-6a34-42b7-bebf-286d1c1527dd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Jan 19 16:17:41.718714 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:41.846088 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-654f193d-ee41-4d29-b515-83b6bb5c905d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "id": "d1"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:41.864702 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:17:41.864702 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Jan 19 16:17:41.889416 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-654f193d-ee41-4d29-b515-83b6bb5c905d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159177 Jan 19 16:17:41.889994 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:17:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:17:41.905655 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0a3afb22-58f7-4726-b956-1e3620995dba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:41.907507 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:17:41.907507 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 19 16:17:41.948442 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0a3afb22-58f7-4726-b956-1e3620995dba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046536 Jan 19 16:17:41.949882 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jan 19 16:17:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:44.342085 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-654f193d-ee41-4d29-b515-83b6bb5c905d admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:44.343816 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-654f193d-ee41-4d29-b515-83b6bb5c905d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jan 19 16:17:44.344223 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:17:44.408580 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-73c488a5-8496-45bd-b373-8807e4d7b393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:44.428259 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-73c488a5-8496-45bd-b373-8807e4d7b393 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077865 Jan 19 16:17:44.436591 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:17:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:17:44.442434 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-af20e05a-7e65-4358-ac69-34c340973d9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:44.468046 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-af20e05a-7e65-4358-ac69-34c340973d9d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029358 Jan 19 16:17:44.469278 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jan 19 16:17:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:17:46.846685 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-73c488a5-8496-45bd-b373-8807e4d7b393 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:46.847840 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-73c488a5-8496-45bd-b373-8807e4d7b393 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jan 19 16:17:46.848616 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:46.927943 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-eb8984e6-74f4-4196-9f3a-3811bb78a119 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "id": "d3"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:46.948791 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-eb8984e6-74f4-4196-9f3a-3811bb78a119 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.092961 Jan 19 16:17:46.949371 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:17:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:17:46.962341 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ec5a6c26-1261-449e-b4a7-1e2fd7fe4e10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:46.989459 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-ec5a6c26-1261-449e-b4a7-1e2fd7fe4e10 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030867 Jan 19 16:17:46.990263 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jan 19 16:17:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:17:49.337089 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-eb8984e6-74f4-4196-9f3a-3811bb78a119 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:49.338110 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-eb8984e6-74f4-4196-9f3a-3811bb78a119 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jan 19 16:17:49.338542 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:49.402306 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-fb4d8f01-f7e4-4c16-9b56-a537751f9beb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "ram": 4096}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:49.429055 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-fb4d8f01-f7e4-4c16-9b56-a537751f9beb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082341 Jan 19 16:17:49.430090 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:17:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:17:49.442296 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-00cc9b01-674c-4c06-baf1-d79d145f343d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:49.471822 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-00cc9b01-674c-4c06-baf1-d79d145f343d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033133 Jan 19 16:17:49.476306 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jan 19 16:17:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:17:52.006687 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-fb4d8f01-f7e4-4c16-9b56-a537751f9beb admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:52.007831 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-fb4d8f01-f7e4-4c16-9b56-a537751f9beb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jan 19 16:17:52.008574 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:17:52.098078 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-c879b33d-9a1f-4a72-b8cd-294011f29698 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:52.123221 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-c879b33d-9a1f-4a72-b8cd-294011f29698 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.107718 Jan 19 16:17:52.123867 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jan 19 16:17:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:17:54.837015 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-fb4d8f01-f7e4-4c16-9b56-a537751f9beb admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:54.838694 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-fb4d8f01-f7e4-4c16-9b56-a537751f9beb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002445 Jan 19 16:17:54.839440 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:54.904590 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5cb5c7c1-26e0-4246-8603-3a941247c53d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "vcpus": 1, "id": "1"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:54.925685 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5cb5c7c1-26e0-4246-8603-3a941247c53d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078556 Jan 19 16:17:54.926347 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:17:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:17:54.939821 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-904cfeb1-9662-4edb-bc7b-a5351f595214 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:54.964970 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-904cfeb1-9662-4edb-bc7b-a5351f595214 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029770 Jan 19 16:17:54.965603 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jan 19 16:17:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:17:57.284535 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5cb5c7c1-26e0-4246-8603-3a941247c53d admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:17:57.285600 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5cb5c7c1-26e0-4246-8603-3a941247c53d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jan 19 16:17:57.286020 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:17:57.372307 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ff091b01-b267-469e-a654-22a71475fe2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:57.395801 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-ff091b01-b267-469e-a654-22a71475fe2b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.101036 Jan 19 16:17:57.396626 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:17:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:17:57.409733 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-becb4050-224e-4ae7-a283-b3c834bc7016 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:17:57.443540 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-becb4050-224e-4ae7-a283-b3c834bc7016 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038625 Jan 19 16:17:57.444417 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jan 19 16:17:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:18:00.294383 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ff091b01-b267-469e-a654-22a71475fe2b admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:00.295396 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-ff091b01-b267-469e-a654-22a71475fe2b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jan 19 16:18:00.295962 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:18:00.383049 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5e742e7e-6a95-44bb-ac59-4c61c013cbd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:00.421021 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5e742e7e-6a95-44bb-ac59-4c61c013cbd6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.117567 Jan 19 16:18:00.422419 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:18:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:18:00.437085 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-4ab0e295-737a-4414-8970-7766d2d4d7b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:00.472209 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-4ab0e295-737a-4414-8970-7766d2d4d7b2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040650 Jan 19 16:18:00.472866 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jan 19 16:18:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:18:03.060196 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5e742e7e-6a95-44bb-ac59-4c61c013cbd6 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:03.061844 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5e742e7e-6a95-44bb-ac59-4c61c013cbd6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 19 16:18:03.062266 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:03.135525 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-e03b5482-23c6-406f-98cb-64af2fd7c26e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:03.160537 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-e03b5482-23c6-406f-98cb-64af2fd7c26e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092098 Jan 19 16:18:03.161298 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:18:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:18:03.175938 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-bb745811-5c41-453d-950b-d187130a84cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:03.209734 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-bb745811-5c41-453d-950b-d187130a84cf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039639 Jan 19 16:18:03.210356 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jan 19 16:18:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:18:05.723731 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-e03b5482-23c6-406f-98cb-64af2fd7c26e admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:05.727458 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-e03b5482-23c6-406f-98cb-64af2fd7c26e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Jan 19 16:18:05.728165 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:05.796375 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-7a86998d-6585-4800-83b2-ecb97f967613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "id": "5", "name": "m1.xlarge"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:05.817875 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-7a86998d-6585-4800-83b2-ecb97f967613 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082711 Jan 19 16:18:05.818693 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jan 19 16:18:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:18:05.830910 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-227c53dd-484a-4ab7-8c42-3ace28a2ca3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:05.859975 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-227c53dd-484a-4ab7-8c42-3ace28a2ca3d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032565 Jan 19 16:18:05.860723 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jan 19 16:18:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:18:29.996181 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-7a86998d-6585-4800-83b2-ecb97f967613 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:29.997183 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-7a86998d-6585-4800-83b2-ecb97f967613 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jan 19 16:18:29.997582 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:30.054236 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-14a0492b-c79e-420d-9639-8a9808c33cd8 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:30.072803 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-14a0492b-c79e-420d-9639-8a9808c33cd8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067825 Jan 19 16:18:30.072803 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jan 19 16:18:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:18:31.440082 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-7a86998d-6585-4800-83b2-ecb97f967613 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:31.441079 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-7a86998d-6585-4800-83b2-ecb97f967613 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 19 16:18:31.441472 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:31.643503 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ff5b3799-03c9-47f8-af70-7e0f04adbf5f admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:31.649254 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-ff5b3799-03c9-47f8-af70-7e0f04adbf5f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 16:18:31.649849 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ff5b3799-03c9-47f8-af70-7e0f04adbf5f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:18:31.650664 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-ff5b3799-03c9-47f8-af70-7e0f04adbf5f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057764 Jan 19 16:18:31.651233 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jan 19 16:18:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 16:18:31.661514 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-d2878bd0-ab51-4423-a201-e9520b3c8781 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:31.683600 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-d2878bd0-ab51-4423-a201-e9520b3c8781 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025481 Jan 19 16:18:31.684218 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jan 19 16:18:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:18:31.694686 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-2d2cb013-bcce-4570-96d1-dc1cc487f6bb admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:31.716542 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-2d2cb013-bcce-4570-96d1-dc1cc487f6bb admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025527 Jan 19 16:18:31.717107 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jan 19 16:18:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:18:31.727216 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-b3472088-6be3-475b-bb51-89ec4c9d0d06 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:31.732844 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-b3472088-6be3-475b-bb51-89ec4c9d0d06 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 19 16:18:31.733731 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-b3472088-6be3-475b-bb51-89ec4c9d0d06 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:18:31.734547 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-b3472088-6be3-475b-bb51-89ec4c9d0d06 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011523 Jan 19 16:18:31.735083 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jan 19 16:18:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 16:18:33.005305 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-2d2cb013-bcce-4570-96d1-dc1cc487f6bb admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:33.006308 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-2d2cb013-bcce-4570-96d1-dc1cc487f6bb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jan 19 16:18:33.006703 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:33.205449 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-bcb6f6f5-775f-466f-8247-791e422f2efa admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:33.211320 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-bcb6f6f5-775f-466f-8247-791e422f2efa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 16:18:33.211881 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-bcb6f6f5-775f-466f-8247-791e422f2efa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:18:33.212697 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-bcb6f6f5-775f-466f-8247-791e422f2efa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061354 Jan 19 16:18:33.213224 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jan 19 16:18:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 16:18:33.223752 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-600fbbe2-0071-473c-865c-be6c32c8b0c1 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:33.238621 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-600fbbe2-0071-473c-865c-be6c32c8b0c1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018503 Jan 19 16:18:33.239212 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jan 19 16:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:18:33.249373 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-372f90d0-8c74-44d1-9911-9e7d10db856a admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:33.263660 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-372f90d0-8c74-44d1-9911-9e7d10db856a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017799 Jan 19 16:18:33.264287 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jan 19 16:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:18:33.274084 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-c359fa58-3bcc-405c-8c7b-a1a16a2b9e48 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:33.279583 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-c359fa58-3bcc-405c-8c7b-a1a16a2b9e48 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 19 16:18:33.280710 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-c359fa58-3bcc-405c-8c7b-a1a16a2b9e48 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:18:33.281525 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-c359fa58-3bcc-405c-8c7b-a1a16a2b9e48 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011072 Jan 19 16:18:33.282072 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jan 19 16:18:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 16:18:34.564993 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-372f90d0-8c74-44d1-9911-9e7d10db856a admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:34.566001 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-372f90d0-8c74-44d1-9911-9e7d10db856a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jan 19 16:18:34.566401 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:34.766051 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-b0b1efb4-f74e-4a30-8844-6231a7585840 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:34.771525 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-b0b1efb4-f74e-4a30-8844-6231a7585840 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 16:18:34.772142 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-b0b1efb4-f74e-4a30-8844-6231a7585840 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:18:34.772995 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-b0b1efb4-f74e-4a30-8844-6231a7585840 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063323 Jan 19 16:18:34.773598 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jan 19 16:18:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 19 16:18:34.783823 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-3db8db5f-fd9f-415b-b4c9-88a476cd7356 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:34.798208 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-3db8db5f-fd9f-415b-b4c9-88a476cd7356 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018648 Jan 19 16:18:34.798774 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jan 19 16:18:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:18:34.808775 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:34.821793 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016886 Jan 19 16:18:34.822330 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jan 19 16:18:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:18:34.831924 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-9bfebb12-9caf-4b69-99a2-9349a7a394b6 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:34.837175 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-9bfebb12-9caf-4b69-99a2-9349a7a394b6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 19 16:18:34.837739 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-9bfebb12-9caf-4b69-99a2-9349a7a394b6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:18:34.838526 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-9bfebb12-9caf-4b69-99a2-9349a7a394b6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010318 Jan 19 16:18:34.839033 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jan 19 16:18:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 19 16:18:36.104891 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:36.105886 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jan 19 16:18:36.106301 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:36.302116 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-68b190ea-4971-4857-8635-305e6cfac781 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:36.321114 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-68b190ea-4971-4857-8635-305e6cfac781 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070150 Jan 19 16:18:36.321643 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jan 19 16:18:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:18:37.580656 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:37.581656 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Jan 19 16:18:37.582043 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:37.778778 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-a4b574cf-b4e9-44c2-a097-bdb954668930 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:37.797926 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-a4b574cf-b4e9-44c2-a097-bdb954668930 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072863 Jan 19 16:18:37.798409 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jan 19 16:18:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:18:39.068297 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:39.069293 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 19 16:18:39.069690 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:39.268190 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2373b32a-d949-4207-af3e-0510a2247e5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:39.286163 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2373b32a-d949-4207-af3e-0510a2247e5b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073535 Jan 19 16:18:39.286639 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jan 19 16:18:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:18:40.563601 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:40.564633 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 19 16:18:40.565025 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:40.758814 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-d1808996-d76d-4687-90c8-5791d852c756 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:18:40.777914 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-d1808996-d76d-4687-90c8-5791d852c756 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069895 Jan 19 16:18:40.778390 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jan 19 16:18:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:18:42.053819 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:42.054808 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jan 19 16:18:42.055194 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:18:42.249738 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-02b5843f-d379-48ac-ab77-2ec6d6811662 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:18:42.269725 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-02b5843f-d379-48ac-ab77-2ec6d6811662 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072318 Jan 19 16:18:42.270202 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Jan 19 16:18:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:19:28.107011 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:19:28.108049 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-3991afbc-a7a8-4fe6-bbf6-6a026c966ff5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 19 16:19:28.108449 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jan 19 16:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:19:28.167594 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4ecd74ef-283d-4f08-b95f-ab1fd93e0951 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:19:28.188599 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4ecd74ef-283d-4f08-b95f-ab1fd93e0951 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074005 Jan 19 16:19:28.189070 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jan 19 16:19:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:19:28.211220 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-807a814d-1e7f-4a62-93a1-e40740e15b6e admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:19:28.218983 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-807a814d-1e7f-4a62-93a1-e40740e15b6e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011313 Jan 19 16:19:28.219513 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Jan 19 16:19:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:19:28.230758 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f271b35c-f556-4212-aa2d-0c65b526cd78 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:19:28.238680 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f271b35c-f556-4212-aa2d-0c65b526cd78 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011444 Jan 19 16:19:28.239221 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Jan 19 16:19:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:19:28.251001 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-12adc4bf-6fd3-4efd-a65c-2272b2aee98b admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:19:28.258678 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-12adc4bf-6fd3-4efd-a65c-2272b2aee98b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011718 Jan 19 16:19:28.259213 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Jan 19 16:19:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:19:28.271732 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:19:28.280052 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011851 Jan 19 16:19:28.280623 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Jan 19 16:19:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:20:53.899879 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-f6c67c10-afa6-4f6e-a18f-615be867ffa6 tempest-verify_tempest_config-773089806 tempest-verify_tempest_config-773089806-project] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:20:53.901827 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-f6c67c10-afa6-4f6e-a18f-615be867ffa6 tempest-verify_tempest_config-773089806 tempest-verify_tempest_config-773089806-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107047 Jan 19 16:20:53.902351 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 35/69] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Jan 19 16:20:53 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:22:22.883546 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:22.884600 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jan 19 16:22:22.884993 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 35/70] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:22:23.140622 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-79202629-c859-4e56-8295-e5e2feaaa1f4 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:23.141790 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:22:23.141790 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 19 16:22:23.143311 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-79202629-c859-4e56-8295-e5e2feaaa1f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:23.143999 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-79202629-c859-4e56-8295-e5e2feaaa1f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:23.144815 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-79202629-c859-4e56-8295-e5e2feaaa1f4 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:23.145252 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-79202629-c859-4e56-8295-e5e2feaaa1f4 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:23.179461 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-79202629-c859-4e56-8295-e5e2feaaa1f4 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152155 Jan 19 16:22:23.180231 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 36/71] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jan 19 16:22:23 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:22:24.448829 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:24.450358 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Jan 19 16:22:24.450746 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 36/72] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:22:24.643353 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-abff9682-932b-4c91-b6de-87e415c887b7 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:24.644778 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:22:24.644778 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 19 16:22:24.646986 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-abff9682-932b-4c91-b6de-87e415c887b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:24.647546 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-abff9682-932b-4c91-b6de-87e415c887b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:24.648830 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-abff9682-932b-4c91-b6de-87e415c887b7 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:24.649384 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-abff9682-932b-4c91-b6de-87e415c887b7 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:24.671529 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-abff9682-932b-4c91-b6de-87e415c887b7 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081477 Jan 19 16:22:24.672052 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 37/73] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jan 19 16:22:24 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:22:36.365865 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:36.366870 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jan 19 16:22:36.367258 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 37/74] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:22:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:22:36.561488 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-788283da-0f9b-42fb-a433-193b23c5a452 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:36.562670 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:22:36.562670 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 19 16:22:36.564210 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-788283da-0f9b-42fb-a433-193b23c5a452 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:36.564657 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-788283da-0f9b-42fb-a433-193b23c5a452 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:36.565489 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-788283da-0f9b-42fb-a433-193b23c5a452 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:36.565927 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-788283da-0f9b-42fb-a433-193b23c5a452 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:36.590016 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-788283da-0f9b-42fb-a433-193b23c5a452 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079767 Jan 19 16:22:36.591098 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 38/75] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jan 19 16:22:36 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:22:37.868078 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:37.869071 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f74e7dfb-8826-45bb-ab40-0108ca6e88f6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 19 16:22:37.869463 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 38/76] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jan 19 16:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:22:38.061210 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-d2f19e2f-abbc-406d-bf3c-f9033e59a946 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:22:38.062418 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:22:38.062418 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 19 16:22:38.064006 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d2f19e2f-abbc-406d-bf3c-f9033e59a946 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:38.064460 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d2f19e2f-abbc-406d-bf3c-f9033e59a946 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:38.065269 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d2f19e2f-abbc-406d-bf3c-f9033e59a946 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:22:38.065729 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-d2f19e2f-abbc-406d-bf3c-f9033e59a946 admin admin] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:22:38.086404 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-d2f19e2f-abbc-406d-bf3c-f9033e59a946 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076008 Jan 19 16:22:38.086949 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 39/77] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jan 19 16:22:38 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:23:38.589186 dv-cinder-784477-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 19 16:23:38.590620 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: Wed Jan 19 16:23:38 2022 - graceful shutdown triggered... Jan 19 16:23:38.591393 dv-cinder-784477-14-iscsi devstack@n-api.service[101779]: Gracefully killing worker 2 (pid: 101779)... Jan 19 16:23:38.591871 dv-cinder-784477-14-iscsi devstack@n-api.service[101778]: Gracefully killing worker 1 (pid: 101778)... Jan 19 16:23:39.590757 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: worker 1 buried after 1 seconds Jan 19 16:23:39.590757 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: worker 2 buried after 1 seconds Jan 19 16:23:39.590757 dv-cinder-784477-14-iscsi devstack@n-api.service[101777]: goodbye to uWSGI. Jan 19 16:23:39.592264 dv-cinder-784477-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 19 16:23:39.592820 dv-cinder-784477-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 19 16:23:39.595498 dv-cinder-784477-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 19 16:23:39.611663 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 19 16:23:39 2022] *** Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: nodename: dv-cinder-784477-14-iscsi Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: machine: x86_64 Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: clock source: unix Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: pcre jit disabled Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: detected number of CPU cores: 4 Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: current working directory: / Jan 19 16:23:39.613792 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: detected binary path: /usr/bin/uwsgi-core Jan 19 16:23:39.614570 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: your processes number limit is 47680 Jan 19 16:23:39.614570 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: your memory page size is 4096 bytes Jan 19 16:23:39.614570 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: detected max file descriptor number: 2048 Jan 19 16:23:39.614570 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: lock engine: pthread robust mutexes Jan 19 16:23:39.614570 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: thunder lock: enabled Jan 19 16:23:39.614570 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 19 16:23:39.614570 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 19 16:23:39.660281 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: Python main interpreter initialized at 0x55bec588c9c0 Jan 19 16:23:39.660281 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: python threads support enabled Jan 19 16:23:39.660281 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: your server socket listen backlog is limited to 100 connections Jan 19 16:23:39.660281 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: your mercy for graceful operations on workers is 90 seconds Jan 19 16:23:39.660742 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: mapped 403077 bytes (393 KB) for 2 cores Jan 19 16:23:39.660742 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: *** Operational MODE: preforking *** Jan 19 16:23:39.661026 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: *** uWSGI is running in multiple interpreter mode *** Jan 19 16:23:39.661026 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: spawned uWSGI master process (pid: 116192) Jan 19 16:23:39.661231 dv-cinder-784477-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 19 16:23:39.664796 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: spawned uWSGI worker 1 (pid: 116209, cores: 1) Jan 19 16:23:39.664796 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: spawned uWSGI worker 2 (pid: 116210, cores: 1) Jan 19 16:23:39.664796 dv-cinder-784477-14-iscsi devstack@n-api.service[116192]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 19 16:23:41.626488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:23:41.626488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: from cryptography.utils import int_from_bytes Jan 19 16:23:41.627151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:23:41.627151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: from cryptography.utils import int_from_bytes Jan 19 16:23:41.633067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:23:41.633067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: from cryptography.utils import int_from_bytes Jan 19 16:23:41.633727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 19 16:23:41.633727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: from cryptography.utils import int_from_bytes Jan 19 16:23:44.065012 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 16:23:44.065579 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 16:23:44.065878 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 16:23:44.066138 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 16:23:44.066406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 16:23:44.066804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.067137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.067466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.067827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.068169 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.068488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.068827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.069154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.069490 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.069754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.070081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.070409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-14-iscsi {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.070740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.071058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.071381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.071722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.072039 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.072369 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.072694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.073201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.074764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.074764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.074764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.075028 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.075359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.075563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.075953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.076259 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.076557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.076870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.077278 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-14-iscsi {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.077609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.077918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.078241 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.078670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.078995 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.079328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.079641 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.080003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.080326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.080662 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.080985 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.081318 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.081646 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.081959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.082277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.082597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.082924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.083247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.083556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.083840 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.084159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.084495 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.084825 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.085157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.085421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.085680 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.086008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.086337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.086656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.086973 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.087293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.087612 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.087954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.088271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.088585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.088903 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.089232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.089557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.090425 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.090801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.091068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.091496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.091777 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.092097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.092451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.092780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.093095 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.093423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.093754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.094067 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.094384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.094697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.095030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.095373 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.095735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.095974 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.096286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.096599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.096925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.097240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.097560 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.097871 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.098182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.098494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.098803 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.099120 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.099435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.099772 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.100085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.100400 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.100715 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.101031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.101645 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.101813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.101972 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.102291 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.102609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.102932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.103247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.103561 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.103906 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.104237 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.104554 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.104875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.105202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.106094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.106412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.106742 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.107056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.107373 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.107726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.107910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 19 16:23:44.108409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.108590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 19 16:23:44.108754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.108754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.109028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 19 16:23:44.109178 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.109336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 19 16:23:44.109500 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.109663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 19 16:23:44.110456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.110646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.110848 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.111048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.111215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.111369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.111539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.111760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.111973 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.112431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.112697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.112849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.113019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.113175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.113338 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.113630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.113801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.113966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.114121 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.114372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.114531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.114686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.114837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.114989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784477-14-iscsi {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.115133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.115286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.115448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.115718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.115883 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.116039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.116188 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.116330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.116481 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.116641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.116784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.116936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.117088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.117232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.117382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.117544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.117708 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.117851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.118001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.118144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.118300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.118443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.118590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.118741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.118890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.119049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.119215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.119359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.119499 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.119653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.119834 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.119992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.120681 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.120845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.120989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.121143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.121286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.121286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.121594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784477-14-iscsi {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.121739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.121891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.122045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.122225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.122722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.122879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.123023 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.123166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.123319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.123463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.123621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.123946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.124119 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.124273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.124557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.124717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.124869 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.125013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.125154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.125313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.125471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.125626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.125770 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.125911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.126062 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.126217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.126378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.126529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.126681 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.126825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.126965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.127117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.127259 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.127410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.127561 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.127761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.127919 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.128083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.128357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.128531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.128685 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.128859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.129084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.129257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.129412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.129556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.129697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.129850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.129850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.130154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.130320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.130987 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.131154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.131308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.131467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.131621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.131858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.132032 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.132187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.132329 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.132504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.132991 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.133156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.133299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.133441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.133599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.133745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.133886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.134204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.134353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.134511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.134779 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.134929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.135080 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.135236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.135387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.135540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.135874 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.136027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.136181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.136341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.136493 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.136493 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.136788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.136788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.137068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.137218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.137371 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.137528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.137674 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.137824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.137975 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.138126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.138284 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.138449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.138600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.138743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.138885 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.139028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.139169 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.139337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.139567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.139747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.139896 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.139896 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.140176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.140342 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.140505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.141031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.141334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.141484 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.141638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.141793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.142011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.142160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.142318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.142475 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.142627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.142796 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.143293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.143452 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.143606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.143866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.144013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.144194 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.144514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.144666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.144930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.145089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.145244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.145406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.145557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.145707 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.145857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.146000 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.146152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.146295 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.146447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.146609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.146754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.146895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.147059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.147202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.147346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.147487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.147747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.147909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.148062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.148213 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.148357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.148508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.148670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.148813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.148965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.152684 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.152918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.153510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.153689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.153849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.154005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.154159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.154313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.154492 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.154784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.154976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.155229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.155379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.155538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.155745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.155900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.156056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.156200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.156200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.156479 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.156479 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.156759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.156759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.157051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.157194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.157346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.157489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.157631 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.157786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.157938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.158081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.158239 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.158390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.158541 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.158684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.158836 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.158994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.159137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.159279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.159430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.159573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.159749 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.159910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.160054 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.160196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.160348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.160491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.160642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.160809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.160954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.161096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.161238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.161643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.162146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.162311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.162457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.162760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 19 16:23:44.162911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.163065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.163246 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.163759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.163938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.164084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.164228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.164378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.164532 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.164685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.164988 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.165141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.165405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.165556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.165711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.165856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.166084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.166084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.166381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.166532 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.166691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.166846 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.166998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.167141 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.167293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.167446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.167596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.167905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.168592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.168751 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.168904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.169059 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.169203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.169346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.169497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.169647 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.169790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.169947 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.170101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.170252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.170408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.170558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.170711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.170862 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.171014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.171164 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.171307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.171449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.171599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.171823 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.172311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.172586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.172766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.173050 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.173235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.173393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.173896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.174050 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.174203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.174355 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.174508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.174654 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.174805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.174956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.175249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.175428 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.175697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.175868 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.176012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.176155 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.176309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.176462 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.176606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.176750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.176750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.177030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.177181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.177374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.177528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.177682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.177838 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.177981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.178132 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.178288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.178439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.178582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.178733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.178891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.179042 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.179200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.179344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.179494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.179638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.179874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.180030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.180174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.180327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.180478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.180620 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.180770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.180924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.181074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.181226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.181376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.181519 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.181674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.181841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.181986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.182240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.182542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.182697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.182840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.182840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.183289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.183478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.183646 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.183890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.184199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.184364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.184509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.184670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.184814 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.184957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.185173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.185432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.185590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.185827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.185979 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.186123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.186277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.186428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.186582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.186724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.186874 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.187024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.187181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.187332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.187483 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.187633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.187810 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.187969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.188120 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.188272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.188414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.188566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.188709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.188861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.189004 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.189186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.189391 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.189542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.189727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.189886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.190112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.190274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.190422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.190608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.190776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.190959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191504 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191907 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.191992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192086 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192718 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192901 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.192994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193078 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.193816 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.194328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.194426 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.194597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.194685 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.194768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.194849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.194946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195032 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195369 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195565 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.195763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196153 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196484 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196834 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196834 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.196996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197078 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197312 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197485 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197660 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.197988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198251 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198588 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.198941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199331 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.199969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200542 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200542 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200542 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.200886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.201786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.202998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.203769 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.204079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.204206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.204558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.204653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.204790 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.205004 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.205233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.205333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.205636 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.205851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.205957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.206238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.206563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.206671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.206884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.207033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.207217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.207531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.207621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.207879 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.208148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.208253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.208501 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.208751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.208852 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.209121 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.209336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.209428 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.209740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.210035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.210157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.210359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.210469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.210675 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.210991 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.211089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.211309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.211589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.211710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.211967 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.212292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.212401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.212603 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.212928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.213045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.213217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.213366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.213820 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.213939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.214027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.214193 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.215294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.215417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.215417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.215755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.215851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.216070 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.216443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.216550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.216710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.216921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.217014 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.217321 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.217503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.217634 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.218050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.218158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.218365 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.218635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.218737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.218988 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.219230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.219320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.219597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.219855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.219967 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.220269 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.220431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.220583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.220897 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.220996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.221210 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.221509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.221601 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.221835 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.222086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.222187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.222570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.222667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.223073 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.223191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.223279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.223604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.223733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.223965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.224305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.224410 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.224631 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.224836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.224941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.225234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.225445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.225551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.225855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.225948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.226178 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.226621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.226741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.226836 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.227034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.227137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.227430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.227634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.227772 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.228085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.228244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.228412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.228733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.228831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.229063 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.229319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.229484 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.229813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.229903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.230133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.231031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.231151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.231367 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.231615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.231740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.232043 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.232217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.232363 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.232676 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.232775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.233189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.233298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.233394 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.233610 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.233868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.234084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.234228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.234456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.234560 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.234841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.235126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.235242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.235459 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.235667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.235829 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.236117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.236310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.236440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.236772 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.236887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.237098 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.237381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.237473 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.237722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.238037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.238318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.238423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.238642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.238935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.239058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.239288 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.239527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.239641 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.239970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.240141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.240309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.241996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.242224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.242322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.242562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.242820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.242916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.243361 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.243469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.243557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.243803 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.243975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.244107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.244411 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.244605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.244710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.245540 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.245635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.245736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.245828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.245914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.245914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.246257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.246362 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.246579 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.247162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.247276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.247375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.247508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.247508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.247821 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.247915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.248178 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.248422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.248515 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.248818 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.249000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.249146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.249475 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.249576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.249811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.250173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.250292 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.250446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.250675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.250774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.251076 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.251261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.251399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.251742 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.251851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.252068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.252349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.252520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.252758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.252955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.253057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.253516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.253623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.253720 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.253936 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.254093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.254516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.254629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.254850 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.255093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.255188 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.255564 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.255691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.255837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.256120 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.256454 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.256763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.257154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.257279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.257375 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.257672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.257777 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.258003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.258279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.258423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.258650 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.258894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.259002 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.259306 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.259447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.259627 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.259886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.259982 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.260301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.260557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.260653 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.260881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.260984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.261204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.261304 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.261523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.261653 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.261891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.261984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.262216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.262319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.262592 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.262700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.262847 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.262948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.263165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.263264 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.263480 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.263574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.263823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.263932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.264138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.264240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.264462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.264543 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.264775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.264877 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.265100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.265191 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.265416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.265521 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.265727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.265820 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.266038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.266129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.266356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.266462 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.266670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.266759 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.266979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.267236 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.267337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.267562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.267663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.267929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.268015 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.268243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.268333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.268553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.268656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.268862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.269001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.269178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.269280 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.269495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.269587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.269805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.269898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.270112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.270203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.270431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.270534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.270739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.270838 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.271045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.271145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.271359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.271456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.271669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.271798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.272002 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.272093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.272315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.272414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.272632 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.272799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.272954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.273172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.273263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.273531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.273627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.273854 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.273937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.274167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.274256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.274476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.274583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.274791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.274890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.275098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.275190 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.275405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.275514 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.275733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.275826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.276044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.276145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.276352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.276520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.276665 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.276755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.276976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.277077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.277823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.277935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.278135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.278229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.278444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.278551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.278799 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.278898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.279111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.279211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.279418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.279517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.279772 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.279881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.280087 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.280175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.280415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.280508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.280730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.280811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.281044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.281124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.281357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.281439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.281665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.281747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.281978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.282057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.282289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.282371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.282607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.282696 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.282914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.283001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.283221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.283310 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.283529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.283609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.283873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.283959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.284187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.284283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.284504 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.284584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.284814 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.284904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.286197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.286550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.286632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.286720 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.286794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.286875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.286947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287338 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287521 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.287883 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.288157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.288157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.288336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.288423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.288498 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289458 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.289958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.290092 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.290288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.290435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.290604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.290753 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.290915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.291069 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.291296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.291396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.291613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.291750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.291955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.292066 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.292266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.292359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.292636 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.292727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.293519 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.293632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.293842 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.293934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.294162 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.294260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.294476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.294568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.294792 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.294881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.295111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.295239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.295430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.295606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.295778 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.296069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.296161 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.296440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.296541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.296772 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.296860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.297093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.297193 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.297415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.297511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.297731 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.297834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.298048 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.298140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.298359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.298451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.298670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.298771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.298991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.299081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.299303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.299397 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.299612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.299733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.299955 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.300045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.300390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.300710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.300916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.301035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.301250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.301352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.301667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.301757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.301983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.302080 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.302294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.302404 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.302613 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.302706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.302941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.303034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.303258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.303391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.303594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.303769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.303966 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.304059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.304301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.304395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.304615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.304717 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.304929 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.305021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.305240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.305337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.305551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.305644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.305867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.305959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.306179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.306271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.306499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.306587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.306811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.306918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.307138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.307241 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.307454 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.307552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.307796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.307904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.308118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.308210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.308468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.308564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.308800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.308901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.309124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.309216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.309441 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.309540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.309779 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.309880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.310097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.310186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.310405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.310510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.310721 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.310823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.311039 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.311150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.311347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.311437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.311661 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.311835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.311990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.312091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.312307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.312402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.312621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.312715 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.312936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.313031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.313245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.313338 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.313554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.313656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.313879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.313971 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.314186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.314293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.314525 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.314656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.314846 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.314947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.315217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.315326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.315492 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.315625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.315835 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.315930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.316161 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.316263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.316473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.316565 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.316790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.316894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.317133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.317236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.317459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.317552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.317789 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.317879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.318111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.318205 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.318440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.318568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.318775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.318878 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.319107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.319199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.319421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.319511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.319767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.319882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.320085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.320186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.320337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 16:23:44.320439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.320722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.321052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.321363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.321672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.321985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.322916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.323238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.323553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.323899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.324242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.324555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.324873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.325202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.325514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.325843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.326161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.326471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.326783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.327126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.327434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.327771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.328111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.328436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.328764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.329097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.329412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.329740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.330061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.330380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.330700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.331021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.331347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.331660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.331999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.332312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.332631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.332952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.333272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.333838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.334171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.334490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.334812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.335131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.335448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.335794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.336110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.336426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.336745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.337055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.337389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.337710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.338035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.338376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.338696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.339016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.339339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.339657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.340684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.341007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.341318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.341635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.341957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.342279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.342596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.342911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.343230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.343545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.343885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.344201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.344517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.344832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.344996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_db.sqlalchemy.engines [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.345163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.345501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.345828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.346146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.346464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.346939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.347383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.347721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.348061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.348389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.348717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.349036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.349361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.349692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.350001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.350308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.350621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.350933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.351238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.351564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.351908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.352217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.352539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.352853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.353400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.353759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.354085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.354418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.354749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.355072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.356037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.356378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.356693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.357005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.357329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.357647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.357956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.358265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.358580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.358893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.359201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.359514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.359844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.360176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.360489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.360798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.361107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.361421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.361729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.362037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.362347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.362657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.362974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.363282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.363596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.363950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.364266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.364575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.364890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.365200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.365534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.365844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.366176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.366471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.366785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.367112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.367430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.367769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.368124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.368446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.369028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.369416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.369742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.370084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.370423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.370736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.371075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.371388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.371747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.372069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.372386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.372703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.373021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.373337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.373653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.373971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.374288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.374603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.374918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.375240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.375586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.375935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.376259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.376584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.376904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.377222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.377540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.377858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.378174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.378497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.378829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.379148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.379461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.379931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.380232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.380554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.380879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.381195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.381523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.381850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.382167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.382491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.382806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.383137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.383554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.383914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.384243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.384551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.384859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.385168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.385488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.385821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.386158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.386481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.387338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.387655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.388005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.388316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.388642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.388966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.389284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.389604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.389936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.390250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.390566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.390883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.391198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.391511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.391849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.392184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.392514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.392826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.393177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.393500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.393823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.394143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.394458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.394791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.395105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.395424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.395763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.396082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.396403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.396723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.397076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.397408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.397735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.398069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.398418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.398735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.399084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.399416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.399758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.400079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.400389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 19 16:23:44.400636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 19 16:23:44.415242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.context [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64672888-0d64-4da8-bffb-e5ab20f1eacc(cell1) {{(pid=116209) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 16:23:44.419792 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:23:44.421320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:23:44.422170 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:23:44.424178 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:23:44.424356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_db.sqlalchemy.engines [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.435733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_db.sqlalchemy.engines [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.436730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_db.sqlalchemy.engines [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.493361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.context [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64672888-0d64-4da8-bffb-e5ab20f1eacc(cell1) {{(pid=116210) load_cells /opt/stack/nova/nova/context.py:464}} Jan 19 16:23:44.497779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:23:44.499379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:23:44.500235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:23:44.502215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:23:44.513594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_db.sqlalchemy.engines [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.515328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_db.sqlalchemy.engines [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.605090 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_db.sqlalchemy.engines [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.682520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_db.sqlalchemy.engines [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 19 16:23:44.934803 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: WARNING keystonemiddleware.auth_token [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:23:44.941271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: WARNING keystonemiddleware.auth_token [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:23:45.015872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: WARNING keystonemiddleware.auth_token [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:23:45.022787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: WARNING keystonemiddleware.auth_token [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:23:45.284667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: WARNING keystonemiddleware.auth_token [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:23:45.290212 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: WARNING keystonemiddleware.auth_token [None req-b16256a9-4d47-4be5-8e99-4721e9547b9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:23:45.297263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bec588c9c0 pid: 116209 (default app) Jan 19 16:23:45.364660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: WARNING keystonemiddleware.auth_token [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 19 16:23:45.369938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: WARNING keystonemiddleware.auth_token [None req-74411f60-8b83-4c09-a6fb-84912f3bdc3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 19 16:23:45.375964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bec588c9c0 pid: 116210 (default app) Jan 19 16:24:20.976521 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b0d66928-8208-4f21-bfcb-b29d35c6c74c tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Action: 'create', calling method: .version_select at 0x7f716cf53dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1351381939", "metadata": {"Type": "work"}}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:20.980042 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b0d66928-8208-4f21-bfcb-b29d35c6c74c tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:24:20.981305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b0d66928-8208-4f21-bfcb-b29d35c6c74c tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.835681 Jan 19 16:24:20.982250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jan 19 16:24:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 840 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:24:21.252107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-634660a2-699b-4224-b0c5-94399e9ec612 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Action: 'create', calling method: .version_select at 0x7f716cfa19d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1257645329", "metadata": {"Type": "work"}}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:21.254486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-634660a2-699b-4224-b0c5-94399e9ec612 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:24:21.255570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-634660a2-699b-4224-b0c5-94399e9ec612 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.267026 Jan 19 16:24:21.260299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jan 19 16:24:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 19 16:24:21.267443 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-70f9d88c-7602-486d-ab06-36d5b44c7ac1 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Action: 'create', calling method: .version_select at 0x7f716cf74940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-826991855", "metadata": {"Type": "work"}}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:21.268875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-70f9d88c-7602-486d-ab06-36d5b44c7ac1 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:24:21.270132 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-70f9d88c-7602-486d-ab06-36d5b44c7ac1 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007054 Jan 19 16:24:21.270885 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jan 19 16:24:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:24:21.283023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-50efcb1b-13e2-4c8e-b344-199286d2584f tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Calling method '.version_select at 0x7f716cf01550>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:21.699836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-50efcb1b-13e2-4c8e-b344-199286d2584f tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] HTTP exception thrown: Volume tempest-invalid-909443891 could not be found. Jan 19 16:24:21.700856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-50efcb1b-13e2-4c8e-b344-199286d2584f tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Returning 404 to user: Volume tempest-invalid-909443891 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:24:21.702108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-50efcb1b-13e2-4c8e-b344-199286d2584f tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-909443891" status: 404 len: 98 microversion: 2.1 time: 0.424681 Jan 19 16:24:21.702913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1214 bytes} [Wed Jan 19 16:24:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-909443891 => generated 98 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 19 16:24:21.713150 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e9fba3f9-74b5-45c3-a9ec-17433a7aec90 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004774 Jan 19 16:24:21.713981 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Jan 19 16:24:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 19 16:24:21.724489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e0ad6def-3cd7-4770-8831-76f2499fb017 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004608 Jan 19 16:24:21.725364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1136 bytes} [Wed Jan 19 16:24:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 19 16:24:21.735024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4a7586d6-ce64-4653-a0d6-5c16fba64e97 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Calling method '.version_select at 0x7f716cf53ee0>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:21.998254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.wsgi [None req-4a7586d6-ce64-4653-a0d6-5c16fba64e97 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] HTTP exception thrown: Volume 24772ce4-f9d0-4a07-9c14-bc6753fe4be1 could not be found. Jan 19 16:24:21.999785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4a7586d6-ce64-4653-a0d6-5c16fba64e97 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Returning 404 to user: Volume 24772ce4-f9d0-4a07-9c14-bc6753fe4be1 could not be found. {{(pid=116209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:24:22.000963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4a7586d6-ce64-4653-a0d6-5c16fba64e97 tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/24772ce4-f9d0-4a07-9c14-bc6753fe4be1" status: 404 len: 109 microversion: 2.1 time: 0.269686 Jan 19 16:24:22.001718 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jan 19 16:24:21 2022] DELETE /compute/v2.1/os-volumes/24772ce4-f9d0-4a07-9c14-bc6753fe4be1 => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:24:22.010692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-06456aaa-d347-48a9-93be-4831572f3d1e tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Calling method '.version_select at 0x7f716ce72ee0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:22.041229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-06456aaa-d347-48a9-93be-4831572f3d1e tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] HTTP exception thrown: Volume 3e0d13c5-94e1-478a-80a0-09098da78ae4 could not be found. Jan 19 16:24:22.042820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-06456aaa-d347-48a9-93be-4831572f3d1e tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] Returning 404 to user: Volume 3e0d13c5-94e1-478a-80a0-09098da78ae4 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:24:22.044031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-06456aaa-d347-48a9-93be-4831572f3d1e tempest-VolumesNegativeTest-818284413 tempest-VolumesNegativeTest-818284413-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3e0d13c5-94e1-478a-80a0-09098da78ae4" status: 404 len: 109 microversion: 2.1 time: 0.037096 Jan 19 16:24:22.045309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:24:22 2022] GET /compute/v2.1/os-volumes/3e0d13c5-94e1-478a-80a0-09098da78ae4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:24:22.964544 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1146719301", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "d8b0d303-631a-44be-8091-f10b96ec14c3"}]}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:23.150938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.network.neutron [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] validate_networks() for [('d8b0d303-631a-44be-8091-f10b96ec14c3', None, None, None, None, None)] {{(pid=116209) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:24:24.200625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1300566818", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "c8881788-33c6-486c-bfe3-c44394cdeb6a"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:24.367012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] validate_networks() for [('c8881788-33c6-486c-bfe3-c44394cdeb6a', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:24:25.655145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:24:25.655734 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:24:25.656074 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:24:25.656710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:24:25.657450 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:24:25.702248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:25.702722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:25.703615 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:25.704084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:25.814146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:25.827825 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for user 9b66fbdfc39840b2962c8d7686098903 and project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:25.863080 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Going to run 1 instances... {{(pid=116209) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:24:25.866666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:24:26.091456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b4168c57-7eb9-4238-a362-9823fb19b26a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.440230 Jan 19 16:24:26.092177 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 5/9] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:24:26.113397 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c3f51e20-8062-4366-827b-42143640398b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:26.116571 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c3f51e20-8062-4366-827b-42143640398b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:26.383904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c3f51e20-8062-4366-827b-42143640398b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:26.426164 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c3f51e20-8062-4366-827b-42143640398b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1218 microversion: 2.1 time: 0.323475 Jan 19 16:24:26.428689 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:26 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1218 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:27.459119 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c7bfdaa6-3ede-4145-92b9-804fb5dcd9d8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:27.466440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c7bfdaa6-3ede-4145-92b9-804fb5dcd9d8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:27.618446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c7bfdaa6-3ede-4145-92b9-804fb5dcd9d8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:27.633410 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c7bfdaa6-3ede-4145-92b9-804fb5dcd9d8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1218 microversion: 2.1 time: 0.180114 Jan 19 16:24:27.637530 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 7/11] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:27 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:24:27.814959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:24:27.815931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:24:27.816579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:24:27.817517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:24:27.818433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:24:27.891462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:27.892290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:27.897056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:27.897525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:28.014044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Getting quotas for project 8c50bdc5baa44900ba916cf4278979bc. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:28.036752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Getting quotas for user dc3df7d104294c75a9ec15182f209db3 and project 8c50bdc5baa44900ba916cf4278979bc. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:28.123600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:24:28.129956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:24:28.366490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0b9204c0-bf21-485d-b699-ec4c2dc8dccb tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.753585 Jan 19 16:24:28.372781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 5/12] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:24:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:24:28.381194 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7aa9f8e3-2665-46f6-abfc-2122abf1f38d tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:28.382760 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7aa9f8e3-2665-46f6-abfc-2122abf1f38d tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:28.574819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7aa9f8e3-2665-46f6-abfc-2122abf1f38d tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:28.584035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7aa9f8e3-2665-46f6-abfc-2122abf1f38d tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1215 microversion: 2.1 time: 0.209519 Jan 19 16:24:28.593100 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:28 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:28.665197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:28.666607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:28.705603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:28.706073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:28.709470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:28.710143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:29.000777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:29.024146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dadd71b7-5133-49e2-b4e2-6fe53eb37958 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1222 microversion: 2.1 time: 0.364397 Jan 19 16:24:29.036078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 6/14] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:28 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1222 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:29.610238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d369ff31-6e58-43d3-b1c9-18152a776949 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:29.610858 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d369ff31-6e58-43d3-b1c9-18152a776949 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:29.812723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d369ff31-6e58-43d3-b1c9-18152a776949 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:29.827558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d369ff31-6e58-43d3-b1c9-18152a776949 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1215 microversion: 2.1 time: 0.220220 Jan 19 16:24:29.830405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 9/15] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:29 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:30.055063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:30.056108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:30.064343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:30.064929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:30.065810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:30.079842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:30.536781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:30.548272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a17d82c-1e17-4347-8e31-6d8cae658d0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1270 microversion: 2.1 time: 0.497659 Jan 19 16:24:30.553849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 7/16] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:30 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1270 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:30.847401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:30.849157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:30.863942 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:30.864780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:30.868420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:30.869140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:31.300838 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:31.338854 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-51e88193-accf-49fa-842a-a95ed1e720e0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1267 microversion: 2.1 time: 0.494102 Jan 19 16:24:31.357248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:30 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1267 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:31.573030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:31.574586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:31.585961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:31.615581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:31.615581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:31.615581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:31.990824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:32.004659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-750e2a7b-b15e-4e43-bd0d-e05cbef83e15 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1276 microversion: 2.1 time: 0.436948 Jan 19 16:24:32.012940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 8/18] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:31 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:32.364481 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:32.365911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:32.392620 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:32.394163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:32.401286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:32.405243 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:32.923448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:32.943713 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1b0da3b2-14ef-4802-86ed-9ccab506c143 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1273 microversion: 2.1 time: 0.584436 Jan 19 16:24:32.953613 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:32 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1273 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:33.039145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:33.040565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:33.063061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:33.063669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:33.074178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:33.075959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:33.674370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:33.711889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-89c830f7-2c39-491a-92d7-03af1c5b2cbd tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1276 microversion: 2.1 time: 0.675741 Jan 19 16:24:33.716237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 9/20] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:33 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1276 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:33.973152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:33.974001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:33.992605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:33.993152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:34.000290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:34.001017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:34.428451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:34.494237 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-38086a59-6b89-4231-a8a1-b371f2254140 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1273 microversion: 2.1 time: 0.519796 Jan 19 16:24:34.500345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 12/21] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:33 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1273 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:34.760907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:34.768893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:34.808547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:34.809856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:34.815431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:34.823454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:35.341468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:35.358510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7d4924dd-fb89-4943-90d1-9f7051f39ee8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1276 microversion: 2.1 time: 0.606848 Jan 19 16:24:35.359600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 10/22] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:34 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1276 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:35.522509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:35.529549 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:35.606806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:35.612165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:35.621028 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:35.625259 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:35.947520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:35.981402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e98962d0-9e32-4aac-837d-5092a203ccb5 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1273 microversion: 2.1 time: 0.465114 Jan 19 16:24:35.982638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 13/23] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:35 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1273 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:36.377435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:36.379331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:36.396708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:36.397266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:36.398110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:36.402490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:36.698346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:36.707845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5321fd0f-5043-47b4-8b5d-3c637bc002f9 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1276 microversion: 2.1 time: 0.334042 Jan 19 16:24:36.708382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:36 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1276 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:24:37.004197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:37.006510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:37.053659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:37.057742 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:37.063496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:37.065630 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:37.735330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:37.736081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:37.755179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:37.759456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:37.762894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:37.763623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:37.993095 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:38.026573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0d7899ca-5505-47b8-9e75-0a2d47c82295 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1273 microversion: 2.1 time: 1.029382 Jan 19 16:24:38.044753 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:36 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1273 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:39.015801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:39.027217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c6ddb668-b9a1-4659-b0b7-cff3ff77f90e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 1.297378 Jan 19 16:24:39.036573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:37 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:24:39.073486 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:39.079065 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:39.125953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:39.128276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:39.133218 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:39.137263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:39.428241 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:39.453985 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f055667f-a5ea-49b2-bc4b-505563b9062b tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1273 microversion: 2.1 time: 0.399738 Jan 19 16:24:39.475891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:39 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1273 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:40.067736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:40.074979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:40.106941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:40.108776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:40.110828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:40.118712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:40.487338 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:40.488507 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:40.497175 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:40.498326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:40.499330 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:40.499968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:40.829190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:40.845338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a0cf0cc4-b8c1-47b3-a458-a03a6ba9e203 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 0.794044 Jan 19 16:24:40.856029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 13/28] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:40 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:41.003566 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:41.014279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fa01a487-b93b-41b9-a58b-4f46b88d7423 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 0.531775 Jan 19 16:24:41.014875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:40 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:41.196765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a93ce39b-1c5c-4e79-9136-041a40f49c74 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'create', calling method: .version_select at 0x7f716c3e1430>, body: {"keypair": {"name": "tempest-keypair-239286550"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:41.271590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-a93ce39b-1c5c-4e79-9136-041a40f49c74 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:41.278180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1689740414", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cd4a436-7a77-4ab5-97ee-344963c7903a"}]}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:41.284720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-a93ce39b-1c5c-4e79-9136-041a40f49c74 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for user 4316011b09014aa49ab3b3309340181e and project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:41.384036 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.network.neutron [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] validate_networks() for [('0cd4a436-7a77-4ab5-97ee-344963c7903a', None, None, None, None, None)] {{(pid=116209) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:24:42.156058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-a93ce39b-1c5c-4e79-9136-041a40f49c74 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:42.175988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-a93ce39b-1c5c-4e79-9136-041a40f49c74 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for user 4316011b09014aa49ab3b3309340181e and project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:42.228465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a93ce39b-1c5c-4e79-9136-041a40f49c74 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.369275 Jan 19 16:24:42.234395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 14/30] 10.222.0.42 () {62 vars in 1198 bytes} [Wed Jan 19 16:24:40 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1376 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:24:42.250768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:42.253374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:42.268167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:42.269354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:42.271098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:42.272595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:44.783077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:44.796308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-16696834-f741-45b1-bf60-21ba9b33d6f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 2.560217 Jan 19 16:24:44.805886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 15/31] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:42 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 2571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:44.811014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:44.815021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:44.829606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:44.831856 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Flavor limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:24:44.832722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Image limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:24:44.833806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:44.834224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Flavor pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:24:44.836092 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Image pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:24:44.837344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:24:44.838735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:44.840231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:44.895031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:44.896528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:44.905886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:44.915027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:45.029990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Getting quotas for project 2f640855c21440159a63a89bfa2a4fea. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:45.042026 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Getting quotas for user a3cf4070604248688b69a8b7c9aedbd5 and project 2f640855c21440159a63a89bfa2a4fea. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:45.086162 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Going to run 1 instances... {{(pid=116209) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:24:45.099509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:24:45.239853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3172db49-1cf4-47fd-b8f7-f2e656fa9433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.200535 Jan 19 16:24:45.239853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 17/32] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:24:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 4213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:24:45.248856 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-348238cb-83af-4f7b-a804-9d32cc89af25 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:45.249132 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-348238cb-83af-4f7b-a804-9d32cc89af25 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:45.730895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-348238cb-83af-4f7b-a804-9d32cc89af25 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:45.741515 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-348238cb-83af-4f7b-a804-9d32cc89af25 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1222 microversion: 2.1 time: 0.500169 Jan 19 16:24:45.760803 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 18/33] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1222 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:24:45.814556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:45.815175 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:45.831502 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:45.832044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:45.843428 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:45.844207 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:46.417982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:46.474997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-de40d1fb-42d9-4786-9c95-6ada6616f960 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 1.650274 Jan 19 16:24:46.481246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 16/34] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:44 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:46.528913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-245945756", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cd4a436-7a77-4ab5-97ee-344963c7903a"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:46.787079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] validate_networks() for [('0cd4a436-7a77-4ab5-97ee-344963c7903a', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:24:46.824461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:46.904888 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5f2637c1-d892-459e-acc1-cfad53fdf847 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 1.073628 Jan 19 16:24:46.928992 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:45 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:47.496996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:47.498148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:47.531629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:47.532989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:47.539469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:47.540733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.066171 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:49.096300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-69bacff2-66f2-43c4-815b-29fdf5a5b331 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 1.604691 Jan 19 16:24:49.100106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 20/36] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:47 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:49.110956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:49.112395 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:49.135530 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:49.137190 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.140109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:49.142555 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.153519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:24:49.154522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:24:49.155175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:24:49.158356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:24:49.160453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:24:49.209643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:49.215307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.217346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:49.221747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.286805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Getting quotas for project 2f640855c21440159a63a89bfa2a4fea. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:49.295596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Getting quotas for user a3cf4070604248688b69a8b7c9aedbd5 and project 2f640855c21440159a63a89bfa2a4fea. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:49.319058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:24:49.323928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:24:49.459595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-629fd708-39ad-40c1-a4aa-6defefc220b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.976201 Jan 19 16:24:49.466051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 17/37] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:24:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:24:49.810171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-bcd9bae5-524d-4196-9e0a-b69db006baf1 req-a15f77fa-bbd9-42c3-a629-b19058a2b880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8891777-99d7-4d44-a6a7-60945ddd6ab2", "tag": "0160ed4b-3862-429e-ab13-5d108761ef8f"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:49.813074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:24:49.813074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:24:49.841302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-bcd9bae5-524d-4196-9e0a-b69db006baf1 req-a15f77fa-bbd9-42c3-a629-b19058a2b880 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:49.841857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-bcd9bae5-524d-4196-9e0a-b69db006baf1 req-a15f77fa-bbd9-42c3-a629-b19058a2b880 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.878671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-bcd9bae5-524d-4196-9e0a-b69db006baf1 req-a15f77fa-bbd9-42c3-a629-b19058a2b880 service nova] Creating event network-changed:0160ed4b-3862-429e-ab13-5d108761ef8f for instance d8891777-99d7-4d44-a6a7-60945ddd6ab2 on hv-cinder-78447 Jan 19 16:24:49.879235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-bcd9bae5-524d-4196-9e0a-b69db006baf1 req-a15f77fa-bbd9-42c3-a629-b19058a2b880 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 16:24:49.888422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc52592d-0473-4178-92d3-30f45a4f1826 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:49.888767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc52592d-0473-4178-92d3-30f45a4f1826 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.889811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc52592d-0473-4178-92d3-30f45a4f1826 None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:49.890564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc52592d-0473-4178-92d3-30f45a4f1826 None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:49.916341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.compute.rpcapi [None req-cc52592d-0473-4178-92d3-30f45a4f1826 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 16:24:49.917722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc52592d-0473-4178-92d3-30f45a4f1826 None None] Releasing lock "compute-rpcapi-router" {{(pid=116210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 16:24:49.959495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cc52592d-0473-4178-92d3-30f45a4f1826 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491980 Jan 19 16:24:49.960635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 18/38] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:24:49.966604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-918c3a89-a712-466b-830f-e5072a4e92ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:49.967329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-918c3a89-a712-466b-830f-e5072a4e92ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:50.201276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-918c3a89-a712-466b-830f-e5072a4e92ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:50.220729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-918c3a89-a712-466b-830f-e5072a4e92ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1221 microversion: 2.1 time: 0.257743 Jan 19 16:24:50.221664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 19/39] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:49 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1221 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:50.239777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:50.240802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:50.256431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:50.257439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:50.260885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:50.261604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:50.590676 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:50.629575 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-13ad4aae-a76f-4642-b5bf-4bc2d790bc22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 1.522196 Jan 19 16:24:50.635256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:49 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:51.749455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:51.762908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-17b6677f-4cbd-48ae-90f6-678eed7a8b43 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 1.537742 Jan 19 16:24:51.763528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 20/41] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:50 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:51.782127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:51.783014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:51.792707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:51.793433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:51.794461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:51.794907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:51.852096 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-87024a68-9243-4e78-b056-034963e086eb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'create', calling method: .version_select at 0x7f716c427dc0>, body: {"keypair": {"name": "tempest-keypair-748099384"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:51.911567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-87024a68-9243-4e78-b056-034963e086eb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:51.926372 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-87024a68-9243-4e78-b056-034963e086eb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for user b63c0a1b76904bf5b187743af7e96e2d and project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:52.227175 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-87024a68-9243-4e78-b056-034963e086eb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:52.249274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-87024a68-9243-4e78-b056-034963e086eb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for user b63c0a1b76904bf5b187743af7e96e2d and project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:52.272278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:52.288004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b34d04e6-b803-4f40-9d59-e2ec18d7a28c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1291 microversion: 2.1 time: 0.519258 Jan 19 16:24:52.292730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 21/42] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:51 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1291 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:52.310941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:52.312153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:52.328635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:52.329508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:52.330920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:52.331400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:52.339664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-87024a68-9243-4e78-b056-034963e086eb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.177047 Jan 19 16:24:52.351924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 22/43] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Jan 19 16:24:51 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:24:52.362460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-9eb30d81-dea1-4d8d-a95d-d7d54c8e2d8f req-6bd2a4b1-da92-42db-9ddc-6da69141a76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5", "tag": "15f82dbd-96d5-469f-b470-9d366356a0d1"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:52.368030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:24:52.368030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:24:52.390829 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-9eb30d81-dea1-4d8d-a95d-d7d54c8e2d8f req-6bd2a4b1-da92-42db-9ddc-6da69141a76c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:52.390829 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-9eb30d81-dea1-4d8d-a95d-d7d54c8e2d8f req-6bd2a4b1-da92-42db-9ddc-6da69141a76c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:52.441219 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-9eb30d81-dea1-4d8d-a95d-d7d54c8e2d8f req-6bd2a4b1-da92-42db-9ddc-6da69141a76c service nova] Creating event network-changed:15f82dbd-96d5-469f-b470-9d366356a0d1 for instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 on hv-cinder-78447 Jan 19 16:24:52.442303 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-9eb30d81-dea1-4d8d-a95d-d7d54c8e2d8f req-6bd2a4b1-da92-42db-9ddc-6da69141a76c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 19 16:24:52.445021 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6719b55a-4d8a-42d7-b1f8-712464ed0a7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:52.446145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6719b55a-4d8a-42d7-b1f8-712464ed0a7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:52.447959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6719b55a-4d8a-42d7-b1f8-712464ed0a7e None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:52.448977 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6719b55a-4d8a-42d7-b1f8-712464ed0a7e None None] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:52.469543 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.compute.rpcapi [None req-6719b55a-4d8a-42d7-b1f8-712464ed0a7e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 19 16:24:52.471208 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6719b55a-4d8a-42d7-b1f8-712464ed0a7e None None] Releasing lock "compute-rpcapi-router" {{(pid=116209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 19 16:24:52.529964 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6719b55a-4d8a-42d7-b1f8-712464ed0a7e None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174270 Jan 19 16:24:52.532873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 23/44] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:24:52.790301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:52.794565 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:52.813413 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:52.814999 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:52.817453 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:52.818493 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:53.122169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:53.159064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-38cd12d3-9edb-4cdd-b2c8-1f40496b5f41 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 0.856637 Jan 19 16:24:53.160725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 22/45] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:52 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:53.317870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:53.320217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:53.349836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:53.358525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:53.360687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:53.363883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:54.356868 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:54.368366 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-793b4dd6-4bb4-47d9-b807-7f22c3d74831 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 1.591266 Jan 19 16:24:54.373624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 24/46] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:52 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:54.383148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:54.387921 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:54.399486 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:54.402366 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:54.405776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:54.408171 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:54.576954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:54.588154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-67dfff17-0ccd-4ac7-a6d3-f888d2b5e9ea tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1321 microversion: 2.1 time: 1.278452 Jan 19 16:24:54.591572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 23/47] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:53 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1321 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:54.650419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1148360036", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc7ab358-3aa6-44a9-98b8-c481c542a661"}], "security_groups": [{"name": "tempest-securitygroup--647109319"}], "key_name": "tempest-keypair-239286550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:54.928364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] validate_networks() for [('fc7ab358-3aa6-44a9-98b8-c481c542a661', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:24:55.739575 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:55.749348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7ac29746-a6ae-4090-aadc-1c04fd2a0599 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 1.374337 Jan 19 16:24:55.757496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:54 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:55.763235 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:55.770615 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:55.793352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:55.794027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:55.795233 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:55.796651 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:56.685589 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:56.694842 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a23af9b7-1456-4c1a-99c9-adacb0c330c2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 0.935931 Jan 19 16:24:56.708831 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 26/49] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:55 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:56.714467 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:56.715115 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:56.737470 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:56.737940 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:56.739527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:56.740226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:57.090139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:24:57.090982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:24:57.091131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:24:57.091541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:24:57.092054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:24:57.107498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:57.107982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:57.110635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:57.123495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:57.179568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for project 49ce668b07c7476c8decace2497dc939. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:24:57.197268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for user 4316011b09014aa49ab3b3309340181e and project 49ce668b07c7476c8decace2497dc939. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:24:57.244434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:24:57.251567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:24:57.333989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-747f4a67-6108-401b-9c61-12048a974299 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.692639 Jan 19 16:24:57.335742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 24/50] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Jan 19 16:24:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 19 16:24:57.351722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-be8ce060-f9bd-485c-9d7d-9ff75e7ead0d req-e96d9916-ccbd-40d0-96ff-588d5529f0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d20a698-3a57-4315-999f-c09f58ed0a9a", "tag": "4aa4e1b6-6c76-4244-8551-db8fd29f4a1e"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:57.355519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:24:57.355519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:24:57.365710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-be8ce060-f9bd-485c-9d7d-9ff75e7ead0d req-e96d9916-ccbd-40d0-96ff-588d5529f0d1 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:57.366459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-be8ce060-f9bd-485c-9d7d-9ff75e7ead0d req-e96d9916-ccbd-40d0-96ff-588d5529f0d1 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:57.379733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-be8ce060-f9bd-485c-9d7d-9ff75e7ead0d req-e96d9916-ccbd-40d0-96ff-588d5529f0d1 service nova] Creating event network-changed:4aa4e1b6-6c76-4244-8551-db8fd29f4a1e for instance 4d20a698-3a57-4315-999f-c09f58ed0a9a on hv-cinder-78447 Jan 19 16:24:57.386871 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:57.391712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-be8ce060-f9bd-485c-9d7d-9ff75e7ead0d req-e96d9916-ccbd-40d0-96ff-588d5529f0d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054211 Jan 19 16:24:57.392957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 25/51] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:24:57.398476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:57.407290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:57.425190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:57.427350 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a18e5014-4aac-41ea-a251-883251a3dfac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1321 microversion: 2.1 time: 0.717002 Jan 19 16:24:57.428341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:57.429453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:57.430188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:57.445374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 27/52] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:56 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1321 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:57.453931 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-833525f0-824d-49be-8404-11617b273f49 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:57.460621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-833525f0-824d-49be-8404-11617b273f49 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:57.570945 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-833525f0-824d-49be-8404-11617b273f49 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:57.586152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-833525f0-824d-49be-8404-11617b273f49 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:57.588502 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-833525f0-824d-49be-8404-11617b273f49 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:57.592621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-833525f0-824d-49be-8404-11617b273f49 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1281 microversion: 2.20 time: 0.145903 Jan 19 16:24:57.604258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 28/53] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:24:57 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:24:57.729597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:57.730517 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:57.746008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:57.747434 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:57.748580 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:57.751947 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:58.232210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:58.269846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1fcb4005-10b3-4b20-8e10-3629df636fb4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 0.873808 Jan 19 16:24:58.289529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 26/54] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:57 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:24:58.457759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:58.458963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:58.490787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:58.491602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:58.517130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:58.517996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:59.115465 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:59.131019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-191039e1-bbfd-421d-a32a-80785f7bf26a tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 1.407305 Jan 19 16:24:59.131868 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 29/55] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:57 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:24:59.139110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:24:59.140119 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:24:59.155799 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:59.159884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:59.161455 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:24:59.162168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:24:59.574027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:59.594016 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:59.603164 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:24:59.615504 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f5e80d48-f255-4295-809c-de08d7a387b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1333 microversion: 2.20 time: 0.482421 Jan 19 16:24:59.625643 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 30/56] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:24:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1333 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:24:59.960390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-94938b0d-5310-47b6-ba68-4e890bf87345 req-af99d554-7c97-414d-b25a-dc8f04bf31fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e119b741-b721-47fa-a03f-be8689acf2fd", "tag": "c02d0a60-5805-45f1-8282-6b84dd2841e0"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:24:59.967513 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:24:59.967513 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:00.000202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-94938b0d-5310-47b6-ba68-4e890bf87345 req-af99d554-7c97-414d-b25a-dc8f04bf31fc service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:00.004616 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-94938b0d-5310-47b6-ba68-4e890bf87345 req-af99d554-7c97-414d-b25a-dc8f04bf31fc service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:00.055711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-94938b0d-5310-47b6-ba68-4e890bf87345 req-af99d554-7c97-414d-b25a-dc8f04bf31fc service nova] Creating event network-changed:c02d0a60-5805-45f1-8282-6b84dd2841e0 for instance e119b741-b721-47fa-a03f-be8689acf2fd on hv-cinder-78447 Jan 19 16:25:00.090888 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-94938b0d-5310-47b6-ba68-4e890bf87345 req-af99d554-7c97-414d-b25a-dc8f04bf31fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.447717 Jan 19 16:25:00.094037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 31/57] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:00.117459 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:00.123527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:00.147634 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:00.148507 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:00.160799 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:00.161758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:00.179604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:00.229372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-df2eb993-b8a1-458d-8a3e-940dd9d61bb8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1321 microversion: 2.1 time: 1.772183 Jan 19 16:25:00.230483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 27/58] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:24:58 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1321 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:00.863026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-30780d0f-cfb7-47f2-8006-26b18d1565ed req-329ce525-4cdd-4678-b247-97e393fd2720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5", "name": "network-vif-plugged", "status": "completed", "tag": "15f82dbd-96d5-469f-b470-9d366356a0d1"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:00.869131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:00.869131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:25:00.888940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-30780d0f-cfb7-47f2-8006-26b18d1565ed req-329ce525-4cdd-4678-b247-97e393fd2720 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:00.890633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-30780d0f-cfb7-47f2-8006-26b18d1565ed req-329ce525-4cdd-4678-b247-97e393fd2720 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:00.934170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-30780d0f-cfb7-47f2-8006-26b18d1565ed req-329ce525-4cdd-4678-b247-97e393fd2720 service nova] Creating event network-vif-plugged:15f82dbd-96d5-469f-b470-9d366356a0d1 for instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 on hv-cinder-78447 Jan 19 16:25:00.957979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-30780d0f-cfb7-47f2-8006-26b18d1565ed req-329ce525-4cdd-4678-b247-97e393fd2720 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.725384 Jan 19 16:25:00.965479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 28/59] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:01.004541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:01.008673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:01.039180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:01.041399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:01.045731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:01.049177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:01.554488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:01.574782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fdf6f9e8-68cd-416d-8680-c1239de742a0 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 1.469680 Jan 19 16:25:01.575518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 32/60] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:00 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:01.589906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:01.594433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:01.595113 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:01.602708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2dddd8dc-9f2f-42cc-8679-06021d2189a0 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 0.633706 Jan 19 16:25:01.604183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 29/61] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:00 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:01.616566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:01.617664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:01.628046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:01.628752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:01.629379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:01.629840 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:01.630184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:01.631044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:01.631192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:01.631854 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:01.791942 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:01.816123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:01.820461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:01.823344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-93202fd2-3f21-4e33-afc4-40dadc443ceb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1339 microversion: 2.20 time: 0.245414 Jan 19 16:25:01.824715 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 33/62] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1339 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:02.112440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:02.125629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a31ebebf-3075-4741-b523-9c7dcd2ccb5e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1321 microversion: 2.1 time: 0.518507 Jan 19 16:25:02.127043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:01 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:02.611046 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:02.613527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:02.633799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:02.637115 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:02.638124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:02.639825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:02.657111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:02.664218 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:02.684883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:02.687544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:02.694424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:02.700003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:03.563711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:03.613253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8423db43-dc3b-4c06-97db-2f8b90277784 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 1.011005 Jan 19 16:25:03.623605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 34/64] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:02 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:03.637149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:03.668476 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:03.670316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:03.700405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:03.702732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:03.707117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c33446bd-4728-4cb9-a476-6661311b3297 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1315 microversion: 2.1 time: 1.087393 Jan 19 16:25:03.711001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:03.714692 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:03.721529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 31/65] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:02 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1315 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:03.754324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-83bf3f5e-9c79-475f-8689-881a243a257a req-dbf9f635-a907-4d53-89b5-c0c690c4fbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8891777-99d7-4d44-a6a7-60945ddd6ab2", "name": "network-vif-plugged", "status": "completed", "tag": "0160ed4b-3862-429e-ab13-5d108761ef8f"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:03.771186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:03.771186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:25:03.817294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-83bf3f5e-9c79-475f-8689-881a243a257a req-dbf9f635-a907-4d53-89b5-c0c690c4fbb5 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:03.822299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-83bf3f5e-9c79-475f-8689-881a243a257a req-dbf9f635-a907-4d53-89b5-c0c690c4fbb5 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:03.909714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-83bf3f5e-9c79-475f-8689-881a243a257a req-dbf9f635-a907-4d53-89b5-c0c690c4fbb5 service nova] Creating event network-vif-plugged:0160ed4b-3862-429e-ab13-5d108761ef8f for instance d8891777-99d7-4d44-a6a7-60945ddd6ab2 on hv-cinder-78447 Jan 19 16:25:03.929386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-83bf3f5e-9c79-475f-8689-881a243a257a req-dbf9f635-a907-4d53-89b5-c0c690c4fbb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203475 Jan 19 16:25:03.935124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 32/66] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:03.951460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:03.957191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:03.972566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:03.973751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:03.976305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:03.980260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:04.282323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:04.348976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:04.351588 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:04.358490 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2644e6ae-7b69-4fdc-a3f5-f5b4c7fa935b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1406 microversion: 2.20 time: 0.727952 Jan 19 16:25:04.359262 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 35/67] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:03 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1406 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:04.367919 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-815141202", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e8425d-6018-4090-9ac6-d49f7dfba7bf"}], "security_groups": [{"name": "tempest-securitygroup--136107936"}], "key_name": "tempest-keypair-748099384", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:04.439076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:04.457948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-53556fc1-ab87-40a3-9d45-d4a5498f2251 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1321 microversion: 2.1 time: 0.520419 Jan 19 16:25:04.460005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 33/68] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:03 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:04.556675 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.network.neutron [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] validate_networks() for [('34e8425d-6018-4090-9ac6-d49f7dfba7bf', None, None, None, None, None)] {{(pid=116209) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:25:04.664226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:04.667526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:04.692638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:04.698232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:04.702510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:04.707253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:05.140273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:05.176444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1e35df0b-bb2a-4718-93ea-b08115eb582b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1318 microversion: 2.1 time: 0.526968 Jan 19 16:25:05.187370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:04 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:05.200356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:05.204926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:05.245933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:05.246760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:05.254112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:05.254776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:05.990638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Flavor limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:25:05.991632 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Image limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:25:05.992707 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Flavor pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:25:05.994003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Image pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:25:05.995239 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:25:06.068269 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.072440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.083716 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.092597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.138822 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for project 8ba3551993a4479e96ab741b8fe10555. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:25:06.148363 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for user b63c0a1b76904bf5b187743af7e96e2d and project 8ba3551993a4479e96ab741b8fe10555. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:25:06.188879 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Going to run 1 instances... {{(pid=116209) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:25:06.192457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:06.196890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:25:06.204345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e77a9a70-8afd-4b14-b0ad-51f3b025c4ff tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1503 microversion: 2.1 time: 1.014458 Jan 19 16:25:06.218681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 35/70] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:05 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1503 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:06.225446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:06.226326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:06.234031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.236902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.239840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.242045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.376493 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e7edfa95-1571-4a30-a7c7-57b68ab23725 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.013504 Jan 19 16:25:06.386990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 36/71] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:25:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:25:06.410009 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:06.411506 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:06.430542 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.434069 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.435346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.439763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.695968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:06.722086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:06.724403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:06.725796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-66e2490c-a2a4-4261-a584-e388dd6adb53 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1406 microversion: 2.20 time: 0.505298 Jan 19 16:25:06.734333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:06 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1406 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:06.756640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-55e71111-2144-45bd-8db2-16d32fb40fd6 req-2972b45d-317a-4697-8c64-60c85e9410fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b42b29d-6ec2-4fd8-b110-48af10080a11", "tag": "6cce95f3-aa82-488b-8999-5b073fe0fc80"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:06.758804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:06.758804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:25:06.777634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-55e71111-2144-45bd-8db2-16d32fb40fd6 req-2972b45d-317a-4697-8c64-60c85e9410fe service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.778335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-55e71111-2144-45bd-8db2-16d32fb40fd6 req-2972b45d-317a-4697-8c64-60c85e9410fe service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.818313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-55e71111-2144-45bd-8db2-16d32fb40fd6 req-2972b45d-317a-4697-8c64-60c85e9410fe service nova] Creating event network-changed:6cce95f3-aa82-488b-8999-5b073fe0fc80 for instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 on hv-cinder-78447 Jan 19 16:25:06.832481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-55e71111-2144-45bd-8db2-16d32fb40fd6 req-2972b45d-317a-4697-8c64-60c85e9410fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083414 Jan 19 16:25:06.833192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 37/73] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:06.853553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-5037a3ed-d78a-4c4d-b0d4-10b30f11aca9 req-930220e2-963e-416f-9b7a-e6f9eac19156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d20a698-3a57-4315-999f-c09f58ed0a9a", "name": "network-vif-plugged", "status": "completed", "tag": "4aa4e1b6-6c76-4244-8551-db8fd29f4a1e"}, {"server_uuid": "e119b741-b721-47fa-a03f-be8689acf2fd", "name": "network-vif-plugged", "status": "completed", "tag": "c02d0a60-5805-45f1-8282-6b84dd2841e0"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:06.857988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:06.857988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:25:06.887466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-5037a3ed-d78a-4c4d-b0d4-10b30f11aca9 req-930220e2-963e-416f-9b7a-e6f9eac19156 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.889045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-5037a3ed-d78a-4c4d-b0d4-10b30f11aca9 req-930220e2-963e-416f-9b7a-e6f9eac19156 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.914688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-5037a3ed-d78a-4c4d-b0d4-10b30f11aca9 req-930220e2-963e-416f-9b7a-e6f9eac19156 service nova] Creating event network-vif-plugged:4aa4e1b6-6c76-4244-8551-db8fd29f4a1e for instance 4d20a698-3a57-4315-999f-c09f58ed0a9a on hv-cinder-78447 Jan 19 16:25:06.916885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-5037a3ed-d78a-4c4d-b0d4-10b30f11aca9 req-930220e2-963e-416f-9b7a-e6f9eac19156 service nova] Creating event network-vif-plugged:c02d0a60-5805-45f1-8282-6b84dd2841e0 for instance e119b741-b721-47fa-a03f-be8689acf2fd on hv-cinder-78447 Jan 19 16:25:06.932045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-5037a3ed-d78a-4c4d-b0d4-10b30f11aca9 req-930220e2-963e-416f-9b7a-e6f9eac19156 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090431 Jan 19 16:25:06.946345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 38/74] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:06.968564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:06.969513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:06.989339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.989797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:06.994267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:06.996363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:07.151526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:07.169999 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-13a2debb-84af-40bb-94d3-c96292ca077a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1321 microversion: 2.1 time: 0.784909 Jan 19 16:25:07.178146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 37/75] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:06 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1321 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:07.191285 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c70deb55-977f-4abb-8c53-5102a5ab4e4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:07.202510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c70deb55-977f-4abb-8c53-5102a5ab4e4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:07.395445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c70deb55-977f-4abb-8c53-5102a5ab4e4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:07.406800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c70deb55-977f-4abb-8c53-5102a5ab4e4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1236 microversion: 2.1 time: 0.226140 Jan 19 16:25:07.407709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 38/76] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1236 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:07.593805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:07.616787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e2a4429b-bd0e-4895-a831-d93e18ee075d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1508 microversion: 2.1 time: 0.657131 Jan 19 16:25:07.620342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 39/77] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:06 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1508 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:07.755581 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:07.756970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:07.773771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:07.774293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:07.776659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:07.776659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:08.061251 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:08.070374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:08.073831 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:08.075768 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2a71120d-c754-4eaf-baf4-fdd940cbd8c2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1406 microversion: 2.20 time: 0.326982 Jan 19 16:25:08.077206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 39/78] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:08.207344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:08.208022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:08.221847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:08.222306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:08.223107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:08.223549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:08.440968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:08.442201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:08.474644 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:08.475274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:08.482445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:08.484558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:08.675603 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:08.686135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-37844556-428b-4c1d-9b42-1503e9f52c95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1288 microversion: 2.1 time: 0.251894 Jan 19 16:25:08.688083 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 40/79] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1288 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:08.707360 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5201a0c5-08af-4d7e-b87c-7ac264408840 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f0273d6-aa9b-4d3c-af1f-945433f698ef"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:08.711667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5201a0c5-08af-4d7e-b87c-7ac264408840 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:08.729745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:08.732432 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5201a0c5-08af-4d7e-b87c-7ac264408840 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:08.733589 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5201a0c5-08af-4d7e-b87c-7ac264408840 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:08.734890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5201a0c5-08af-4d7e-b87c-7ac264408840 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:08.735613 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5201a0c5-08af-4d7e-b87c-7ac264408840 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:08.737733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20c78b25-091f-4786-872a-65a4be575769 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1321 microversion: 2.1 time: 0.534233 Jan 19 16:25:08.738441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 40/80] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:08 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:09.095766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:09.096606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:09.110543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:09.113947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:09.120086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:09.124271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:09.589095 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5201a0c5-08af-4d7e-b87c-7ac264408840 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "POST /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891444 Jan 19 16:25:09.589954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 41/81] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:25:08 2022] POST /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:09.604553 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ed060514-c5aa-4f4c-876b-a2c38009f3da tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9600b358-62b0-4015-a2b1-5b018836f2ea"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:09.605963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ed060514-c5aa-4f4c-876b-a2c38009f3da tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:09.627356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed060514-c5aa-4f4c-876b-a2c38009f3da tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:09.631056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed060514-c5aa-4f4c-876b-a2c38009f3da tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:09.633146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed060514-c5aa-4f4c-876b-a2c38009f3da tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:09.636101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed060514-c5aa-4f4c-876b-a2c38009f3da tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:09.898207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:09.926719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:09.930870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:09.934459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-862d9c71-65cb-4700-a9b2-19283c405641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1406 microversion: 2.20 time: 0.843159 Jan 19 16:25:09.936625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 41/82] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:09 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1406 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:25:09.965593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:09.967771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:09.997131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:09.997669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:10.002983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:10.003750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:10.217453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:10.231250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9fdd6473-b8a1-48f0-b01c-80e7f3cb19e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1294 microversion: 2.1 time: 0.292425 Jan 19 16:25:10.242746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 42/83] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1294 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:10.257338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:10.263793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:10.283260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:10.284884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:10.288521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:10.288661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:10.333594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ed060514-c5aa-4f4c-876b-a2c38009f3da tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736324 Jan 19 16:25:10.344716 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 42/84] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:25:09 2022] POST /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:10.603373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:10.611658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40ab20d4-815a-46f9-b32d-585ed731a998 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1514 microversion: 2.1 time: 0.366726 Jan 19 16:25:10.612298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 43/85] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:10 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:10.637040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:10.641290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:10.667781 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:10.669729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:10.672131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:10.674222 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:10.752761 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.objects.instance [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lazy-loading 'flavor' on Instance uuid 4d20a698-3a57-4315-999f-c09f58ed0a9a {{(pid=116209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:25:10.991569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:11.017606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:11.088709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:11.090810 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ed4153be-87de-4c1c-85e4-b26f59a648fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a/action" status: 200 len: 32 microversion: 2.1 time: 0.461451 Jan 19 16:25:11.091434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:11.093489 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 43/86] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:10 2022] POST /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a/action => generated 32 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:11.103425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:11.104331 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:11.105051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:11.110628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:11.130810 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:11.134791 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:11.137384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:11.141239 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:11.701092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:11.710328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:11.713225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:11.714774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-94efc2a9-1eab-4832-884e-fedee6523dda tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1406 microversion: 2.20 time: 0.762530 Jan 19 16:25:11.726795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 44/87] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:10 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1406 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:11.732613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:11.733472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:11.737619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:11.740612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:11.741330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:11.742326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:11.742927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:11.752088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bf8c31a2-90ab-4163-8be6-2d91df3b5ac7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.651308 Jan 19 16:25:11.764238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 44/88] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:11 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:12.597331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:12.622098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e0b0b12b-9bdf-4db1-9ccb-5089019b4aa0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.893091 Jan 19 16:25:12.623224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 45/89] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:12.739135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:12.740545 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:12.769007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:12.771592 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:12.776995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:12.778149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:12.778322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:12.780082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:12.814889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:12.815721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:12.818354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:12.819462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:13.408097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:13.428396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:13.431585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:13.435483 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:13.438142 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-82623254-e366-4322-9297-4553c68df258 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1406 microversion: 2.20 time: 0.707299 Jan 19 16:25:13.439725 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 45/90] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1406 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:13.442459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-df7040eb-1b6f-4f49-aa00-3a58cca71587 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.673844 Jan 19 16:25:13.448039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 46/91] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:12 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:13.451706 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-d27b0238-8004-4f90-acec-a304c4655627 req-5cda3767-32e4-4f73-9be6-51eb79d9d3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b42b29d-6ec2-4fd8-b110-48af10080a11", "name": "network-vif-plugged", "status": "completed", "tag": "6cce95f3-aa82-488b-8999-5b073fe0fc80"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:13.456516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:13.456516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:13.476137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-d27b0238-8004-4f90-acec-a304c4655627 req-5cda3767-32e4-4f73-9be6-51eb79d9d3aa service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:13.477540 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-d27b0238-8004-4f90-acec-a304c4655627 req-5cda3767-32e4-4f73-9be6-51eb79d9d3aa service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:13.500631 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-d27b0238-8004-4f90-acec-a304c4655627 req-5cda3767-32e4-4f73-9be6-51eb79d9d3aa service nova] Creating event network-vif-plugged:6cce95f3-aa82-488b-8999-5b073fe0fc80 for instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 on hv-cinder-78447 Jan 19 16:25:13.510456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-d27b0238-8004-4f90-acec-a304c4655627 req-5cda3767-32e4-4f73-9be6-51eb79d9d3aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067847 Jan 19 16:25:13.512104 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 46/92] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:13.670008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:13.670664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:13.697117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-91b1d58f-5648-4c97-a5a1-4070e45874fe req-35f8f860-0ec8-415f-b9a4-4f00b0d67b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f71c7f-dd64-49e3-b9fe-5096584b8e66", "tag": "ce0ade64-627f-46d5-b735-2fa587d4c9e2"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:13.702307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:13.705379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:13.710242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:13.710860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:13.712978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:13.712978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:13.792558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-91b1d58f-5648-4c97-a5a1-4070e45874fe req-35f8f860-0ec8-415f-b9a4-4f00b0d67b8b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:13.794599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-91b1d58f-5648-4c97-a5a1-4070e45874fe req-35f8f860-0ec8-415f-b9a4-4f00b0d67b8b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:13.870731 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-91b1d58f-5648-4c97-a5a1-4070e45874fe req-35f8f860-0ec8-415f-b9a4-4f00b0d67b8b service nova] Creating event network-changed:ce0ade64-627f-46d5-b735-2fa587d4c9e2 for instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 on hv-cinder-78447 Jan 19 16:25:13.881183 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-91b1d58f-5648-4c97-a5a1-4070e45874fe req-35f8f860-0ec8-415f-b9a4-4f00b0d67b8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198289 Jan 19 16:25:13.883951 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 47/93] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:14.044197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:14.053482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f9fab478-47a7-4583-afec-cff22d956f86 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.389723 Jan 19 16:25:14.063904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 47/94] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:14.483738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:14.487203 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:14.492382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:14.496805 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:14.520900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:14.521932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:14.523230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:14.527775 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:14.529200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:14.532217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:14.533001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:14.536901 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:15.047589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:15.065455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-424e5486-9d47-4013-b759-d0eea32f9d8a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.596022 Jan 19 16:25:15.088408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 48/95] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:14 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:15.095733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:15.097206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:15.111260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:15.129122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:15.130780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:15.131602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:15.186471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:15.199536 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:15.201297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:15.204621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-53fc7966-a01d-40fc-ba6c-90746b94ce80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1406 microversion: 2.20 time: 0.736148 Jan 19 16:25:15.205841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 48/96] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:14 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1406 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:25:15.451295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:15.476029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1df58f0e-619d-4c64-8aba-283feb50f51c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.384124 Jan 19 16:25:15.488074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 49/97] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:16.099487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:16.100154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:16.116980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.117477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.118586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.119066 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.233558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:16.234828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:16.246296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.247652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.248690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.250873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.574228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:16.582616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:16.584345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:16.585639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2e29c824-ca48-4668-a0d1-c28c0308ad92 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1599 microversion: 2.20 time: 0.356625 Jan 19 16:25:16.586318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 50/98] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:25:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1599 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:16.591871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:16.592726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:16.601570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.603010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.604242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.604927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.621487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:16.664916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ea49909f-25d1-47af-8542-642c62730078 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.568861 Jan 19 16:25:16.683900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 49/99] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:16 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:16.693290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d382b655-1355-4f8b-95d1-e83f717dde8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:16.694121 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d382b655-1355-4f8b-95d1-e83f717dde8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:16.705911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d382b655-1355-4f8b-95d1-e83f717dde8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.706770 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d382b655-1355-4f8b-95d1-e83f717dde8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.708187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d382b655-1355-4f8b-95d1-e83f717dde8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:16.709270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d382b655-1355-4f8b-95d1-e83f717dde8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:16.992817 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d382b655-1355-4f8b-95d1-e83f717dde8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.306717 Jan 19 16:25:16.994803 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 50/100] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Jan 19 16:25:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-interface => generated 285 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:25:17.102194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:17.117707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bdeea0fd-6e83-4dcd-ad52-40af9c0c97ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.529015 Jan 19 16:25:17.120049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 51/101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:17.683290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:17.684740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:17.695660 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:17.696743 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:17.697679 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:17.698120 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:18.082011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:18.102978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-378173e6-3b28-429a-b3c2-d4891658662e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.423372 Jan 19 16:25:18.105340 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 51/102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:17 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:18.145256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:18.146483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:18.175376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:18.175877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:18.181534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:18.184849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:18.569970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:18.585299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0bfbc792-310a-4004-9db4-175379e94bf6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.447444 Jan 19 16:25:18.587240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 52/103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:19.129298 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:19.131997 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:19.166606 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.169123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:19.171591 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.175260 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:19.306286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:19.307577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:19.323580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.324663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:19.325835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.326520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:19.369799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:25:19.583302 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:19.598819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-099ab8e1-8012-4a50-8b48-47a1da4670fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.478625 Jan 19 16:25:19.619359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 52/104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:19 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:19.636080 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:19.637236 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:19.659487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.671643 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:19.674211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.674998 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:19.709894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7a7566d2-5f37-4282-8553-790bc6f33325 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 204 len: 0 microversion: 2.1 time: 0.410934 Jan 19 16:25:19.711317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 53/105] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:25:19 2022] DELETE /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:25:19.740126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:19.740126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:19.740400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.755992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:19.762537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:19.764063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:20.267281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:20.277258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2b1a46a0-1f3f-4fe0-a87b-a6124b76ffa2 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1555 microversion: 2.1 time: 0.557220 Jan 19 16:25:20.281870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 54/106] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:19 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1555 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:20.293068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4fcb115f-7e2c-447a-bf56-40403e9c562f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:20.297720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4fcb115f-7e2c-447a-bf56-40403e9c562f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:20.315765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fcb115f-7e2c-447a-bf56-40403e9c562f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:20.317175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fcb115f-7e2c-447a-bf56-40403e9c562f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:20.319351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fcb115f-7e2c-447a-bf56-40403e9c562f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:20.322398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fcb115f-7e2c-447a-bf56-40403e9c562f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:20.431957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:20.432875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4fcb115f-7e2c-447a-bf56-40403e9c562f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.141525 Jan 19 16:25:20.433154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 55/107] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:20 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:20.443513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-afca8bcf-a336-42d0-bb8f-cf4ddde8c566 req-69f33c66-47e1-4cb6-8da2-990fdb68a739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b42b29d-6ec2-4fd8-b110-48af10080a11", "tag": "6cce95f3-aa82-488b-8999-5b073fe0fc80"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:20.448377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:20.448377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:25:20.449903 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-07899464-d6b6-4293-9f00-58cb14f626fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.825520 Jan 19 16:25:20.461662 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 53/108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:20.467163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-afca8bcf-a336-42d0-bb8f-cf4ddde8c566 req-69f33c66-47e1-4cb6-8da2-990fdb68a739 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:20.467804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-afca8bcf-a336-42d0-bb8f-cf4ddde8c566 req-69f33c66-47e1-4cb6-8da2-990fdb68a739 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:20.488276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-afca8bcf-a336-42d0-bb8f-cf4ddde8c566 req-69f33c66-47e1-4cb6-8da2-990fdb68a739 service nova] Creating event network-changed:6cce95f3-aa82-488b-8999-5b073fe0fc80 for instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 on hv-cinder-78447 Jan 19 16:25:20.498131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-afca8bcf-a336-42d0-bb8f-cf4ddde8c566 req-69f33c66-47e1-4cb6-8da2-990fdb68a739 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059992 Jan 19 16:25:20.501845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 56/109] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:20.634032 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:20.635184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:20.650900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:20.656384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:20.659799 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:20.660664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:20.974487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:21.006305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0c2de551-34a9-4d47-a7c8-f6d8d6cffb6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.371867 Jan 19 16:25:21.007465 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 54/110] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:20 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:21.299408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:21.300305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:21.310537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:21.311362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:21.312457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:21.312959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:21.448817 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f051b7c9-89df-4a33-8bde-f46551db8255 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:21.450547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f051b7c9-89df-4a33-8bde-f46551db8255 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:21.462232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f051b7c9-89df-4a33-8bde-f46551db8255 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:21.463049 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f051b7c9-89df-4a33-8bde-f46551db8255 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:21.464492 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f051b7c9-89df-4a33-8bde-f46551db8255 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:21.465520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f051b7c9-89df-4a33-8bde-f46551db8255 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:21.555970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:21.571986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8a1ff671-f8b1-4f11-91df-0c6e39516d28 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1555 microversion: 2.1 time: 0.276868 Jan 19 16:25:21.573190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 57/111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:21 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:21.581886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:21.583387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:21.594399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:21.594995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:21.596138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:21.596685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:21.800062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:21.808775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2770ea90-342e-44e6-bb27-b639919bdee7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.234107 Jan 19 16:25:21.810165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 58/112] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:21.816011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-b23ab20e-2d56-49f3-ac77-ff86606f2b46 req-e4ae656d-99c7-425d-93c9-1ec06dcdb71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f71c7f-dd64-49e3-b9fe-5096584b8e66", "name": "network-vif-plugged", "status": "completed", "tag": "ce0ade64-627f-46d5-b735-2fa587d4c9e2"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:21.818008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:21.818008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:25:21.826896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-b23ab20e-2d56-49f3-ac77-ff86606f2b46 req-e4ae656d-99c7-425d-93c9-1ec06dcdb71d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:21.827715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-b23ab20e-2d56-49f3-ac77-ff86606f2b46 req-e4ae656d-99c7-425d-93c9-1ec06dcdb71d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:21.846317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-b23ab20e-2d56-49f3-ac77-ff86606f2b46 req-e4ae656d-99c7-425d-93c9-1ec06dcdb71d service nova] Creating event network-vif-plugged:ce0ade64-627f-46d5-b735-2fa587d4c9e2 for instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 on hv-cinder-78447 Jan 19 16:25:21.852094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-b23ab20e-2d56-49f3-ac77-ff86606f2b46 req-e4ae656d-99c7-425d-93c9-1ec06dcdb71d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040339 Jan 19 16:25:21.853483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 59/113] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:22.025760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:22.026497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:22.033910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:22.034372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:22.035195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:22.035644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:22.210032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:22.222261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4813fda3-3c92-4789-8888-27c9f7cba246 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.200669 Jan 19 16:25:22.225954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 60/114] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:22 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:22.598121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:22.598779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:22.606044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:22.606505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:22.607580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:22.607580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:22.754492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:22.764599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-35500d57-2032-4cd7-a63d-7407d549f3c1 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1555 microversion: 2.1 time: 0.170189 Jan 19 16:25:22.765198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 61/115] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:22 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:22.834131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:22.834751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:22.840850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:22.841311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:22.842107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:22.842547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:22.998306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:23.006106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0f122697-3720-48ee-8261-b1caaa421d59 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.175479 Jan 19 16:25:23.006704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 62/116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:23.248459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:23.249085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:23.256747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:23.257420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:23.258650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:23.259357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:23.422977 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f051b7c9-89df-4a33-8bde-f46551db8255 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 1.980948 Jan 19 16:25:23.424186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 55/117] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:21 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:23.433370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:23.442134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6a426131-6ad3-4cb3-92ee-8baeedc57ebd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.197377 Jan 19 16:25:23.442838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 63/118] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:23 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:23.786996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:23.788332 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:23.801106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:23.801899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:23.803392 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:23.803950 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:24.006538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:24.017071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ccce95eb-0074-4976-9774-fed2fd7f0237 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1555 microversion: 2.1 time: 0.237100 Jan 19 16:25:24.018076 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 56/119] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:23 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:24.028677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:24.029297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:24.037314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:24.038189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:24.039313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:24.039785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:24.206199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:24.214382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-11dbe3c4-7528-424b-993e-34dfe66aa0fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 0.190629 Jan 19 16:25:24.214982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 64/120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:24.441715 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7647277f-8aa0-4345-b134-264088cbb61f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:24.443421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7647277f-8aa0-4345-b134-264088cbb61f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:24.473061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:24.474358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:24.482671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7647277f-8aa0-4345-b134-264088cbb61f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:24.483524 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7647277f-8aa0-4345-b134-264088cbb61f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:24.485096 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7647277f-8aa0-4345-b134-264088cbb61f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:24.485909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7647277f-8aa0-4345-b134-264088cbb61f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:24.510795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:24.511586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:24.525791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:24.526590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:24.635781 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7647277f-8aa0-4345-b134-264088cbb61f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.200662 Jan 19 16:25:24.637474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 57/121] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:24 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:24.813968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:24.829042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3226f3d9-d8c8-4264-b1b3-04351561e3b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.370473 Jan 19 16:25:24.848077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 65/122] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:24 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:25.040032 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:25.041732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:25.056000 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.057346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:25.060241 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.061336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:25.235824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:25.236566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:25.256800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.257745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:25.260428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.261888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:25.777855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:25.797247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1b55e00e-4b70-4b3c-87d8-49fe2ca2b421 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1555 microversion: 2.1 time: 0.764917 Jan 19 16:25:25.798315 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 58/123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:25 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1555 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:25.808569 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-20d25a38-4ca9-48d2-99f1-9067f5d740b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:25.810145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-20d25a38-4ca9-48d2-99f1-9067f5d740b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:25.827034 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20d25a38-4ca9-48d2-99f1-9067f5d740b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.828390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20d25a38-4ca9-48d2-99f1-9067f5d740b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:25.829910 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20d25a38-4ca9-48d2-99f1-9067f5d740b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.830755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20d25a38-4ca9-48d2-99f1-9067f5d740b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:25.944794 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-20d25a38-4ca9-48d2-99f1-9067f5d740b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.143756 Jan 19 16:25:25.950318 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 59/124] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:25 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:25.956747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:25.957895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:25.970131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.971206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:25.972853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:25.973819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:26.287181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:26.324531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-134c3906-475a-4ea4-95cd-a47b739a8f21 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1361 microversion: 2.1 time: 1.094506 Jan 19 16:25:26.328127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 66/125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1361 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:26.452387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1157522564", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "d8b0d303-631a-44be-8091-f10b96ec14c3"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:26.510166 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:26.525315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] validate_networks() for [('d8b0d303-631a-44be-8091-f10b96ec14c3', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:25:26.543760 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-863f2bcd-613c-4a23-92a7-fec2a3c67dd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.595541 Jan 19 16:25:26.544605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 60/126] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:25 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:26.816460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:26.817983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:26.826112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:26.826557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:26.827549 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:26.828017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.239386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:27.262398 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b6347ad2-10ac-4448-ac00-4daa50afca08 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1555 microversion: 2.1 time: 0.449726 Jan 19 16:25:27.270388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 61/127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:26 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1555 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:27.280801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-385a9a10-fcbc-46a6-bea7-1a1664fd45bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:27.281703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-385a9a10-fcbc-46a6-bea7-1a1664fd45bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:27.294024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-385a9a10-fcbc-46a6-bea7-1a1664fd45bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.295162 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-385a9a10-fcbc-46a6-bea7-1a1664fd45bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.297055 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-385a9a10-fcbc-46a6-bea7-1a1664fd45bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.298980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-385a9a10-fcbc-46a6-bea7-1a1664fd45bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.456374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-385a9a10-fcbc-46a6-bea7-1a1664fd45bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.189547 Jan 19 16:25:27.457052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:25:27.457908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:25:27.459043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:25:27.460105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:25:27.460903 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 62/128] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:27 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:27.461240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:25:27.469371 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-026a0746-2d32-4da6-a9ce-928b3f7db9ff req-6c5836f1-67b0-4df3-847f-50af202f4194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5", "name": "network-vif-deleted", "tag": "15f82dbd-96d5-469f-b470-9d366356a0d1"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:27.473732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:27.473732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:27.480469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-026a0746-2d32-4da6-a9ce-928b3f7db9ff req-6c5836f1-67b0-4df3-847f-50af202f4194 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.480934 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-026a0746-2d32-4da6-a9ce-928b3f7db9ff req-6c5836f1-67b0-4df3-847f-50af202f4194 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.496469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-026a0746-2d32-4da6-a9ce-928b3f7db9ff req-6c5836f1-67b0-4df3-847f-50af202f4194 service nova] Creating event network-vif-deleted:15f82dbd-96d5-469f-b470-9d366356a0d1 for instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 on hv-cinder-78447 Jan 19 16:25:27.503036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.503456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-026a0746-2d32-4da6-a9ce-928b3f7db9ff req-6c5836f1-67b0-4df3-847f-50af202f4194 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039573 Jan 19 16:25:27.504497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.507279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.508121 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 63/129] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:27.517377 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:27.518430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:27.530767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.530767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.530767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.530767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.535961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.625815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:25:27.637422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for user 9b66fbdfc39840b2962c8d7686098903 and project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:25:27.684048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:25:27.684621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:25:27.746165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:27.767705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-40bb6f29-0a78-433c-a959-2094d2c4fa47 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1547 microversion: 2.1 time: 0.256482 Jan 19 16:25:27.769030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 64/130] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1547 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:27.787176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-659d588e-bca8-4e9e-ac11-bf3bc67a42d5 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341246 Jan 19 16:25:27.788420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 67/131] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:25:27.796403 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:27.796403 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:27.797364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dfeb2447-3e5e-414d-924e-5fcc233e416e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:27.798547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dfeb2447-3e5e-414d-924e-5fcc233e416e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:27.813999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfeb2447-3e5e-414d-924e-5fcc233e416e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.815433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfeb2447-3e5e-414d-924e-5fcc233e416e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.817269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfeb2447-3e5e-414d-924e-5fcc233e416e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.818248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfeb2447-3e5e-414d-924e-5fcc233e416e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.836623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.837451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:27.839439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:27.839728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:28.141738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dfeb2447-3e5e-414d-924e-5fcc233e416e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.350185 Jan 19 16:25:28.141738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jan 19 16:25:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:28.152022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4c9c9cc7-4954-43d3-b8e9-7b3306f277d4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:28.152563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4c9c9cc7-4954-43d3-b8e9-7b3306f277d4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:28.211894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:28.228774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-11e4c4bf-5cdb-4abb-af09-c325abb1a8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.458409 Jan 19 16:25:28.229229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 65/133] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:27 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:28.257737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4c9c9cc7-4954-43d3-b8e9-7b3306f277d4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:28.266585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4c9c9cc7-4954-43d3-b8e9-7b3306f277d4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1218 microversion: 2.1 time: 0.118337 Jan 19 16:25:28.267535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:28 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:28.292339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:28.292848 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:28.301167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:28.301623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:28.302437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:28.302917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:28.343890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:28.344346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:28.344795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.objects.instance [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lazy-loading 'fault' on Instance uuid 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 {{(pid=116209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:25:28.425340 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3df7d104294c75a9ec15182f209db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c50bdc5baa44900ba916cf4278979bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:28.449510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3faa1bd4-2866-4a06-8d88-9c6fdde57f33 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 200 len: 1351 microversion: 2.1 time: 0.163426 Jan 19 16:25:28.451151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 66/135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:28 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 1351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:28.469414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6f67f2dd-9fc3-49d8-bfdc-78a3038cdc20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:28.470406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6f67f2dd-9fc3-49d8-bfdc-78a3038cdc20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:28.644764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f67f2dd-9fc3-49d8-bfdc-78a3038cdc20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:28.645530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f67f2dd-9fc3-49d8-bfdc-78a3038cdc20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:28.646575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f67f2dd-9fc3-49d8-bfdc-78a3038cdc20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:28.647187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f67f2dd-9fc3-49d8-bfdc-78a3038cdc20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:28.747006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6f67f2dd-9fc3-49d8-bfdc-78a3038cdc20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.279342 Jan 19 16:25:28.748643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 70/136] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:28 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:29.256173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:29.258937 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:29.272369 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.273603 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.275595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.276730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.299549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:29.303005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:29.322149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.323787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.325816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.328573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.511013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:29.525704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-21ec8aad-6129-42c4-9ca3-8e13a20471f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1270 microversion: 2.1 time: 0.234409 Jan 19 16:25:29.540046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:29 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:29.540046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:29.540729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:29.549091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.549468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.551194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.551878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.568710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] HTTP exception thrown: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. Jan 19 16:25:29.569446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Returning 404 to user: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:25:29.580058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-83c5ac59-dcc6-4edc-81c4-39e210701498 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 404 len: 111 microversion: 2.1 time: 0.042016 Jan 19 16:25:29.580058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 72/138] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:29 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:25:29.728654 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:29.746909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-92ff35aa-2ed1-4279-aa21-ede96cfc3c3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.498854 Jan 19 16:25:29.765189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 67/139] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:29 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:29.768349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f7f3c5ce-d92d-486e-8b7c-a22001d8ba07 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:29.769543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f7f3c5ce-d92d-486e-8b7c-a22001d8ba07 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:29.798325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7f3c5ce-d92d-486e-8b7c-a22001d8ba07 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.799173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7f3c5ce-d92d-486e-8b7c-a22001d8ba07 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.803961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7f3c5ce-d92d-486e-8b7c-a22001d8ba07 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.806197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7f3c5ce-d92d-486e-8b7c-a22001d8ba07 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.958496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:29.959509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:29.965494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f7f3c5ce-d92d-486e-8b7c-a22001d8ba07 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.207279 Jan 19 16:25:29.966155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 73/140] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:29 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:29.975802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.980797 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:29.981906 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:29.982230 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.016625 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.wsgi [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] HTTP exception thrown: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. Jan 19 16:25:30.025038 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Returning 404 to user: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. {{(pid=116209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:25:30.027411 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b45a2e95-7855-4170-b72e-33a73621449f tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073080 Jan 19 16:25:30.035026 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 68/141] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:25:29 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5/os-volume_attachments => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:25:30.217597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2683e995-956a-4a17-a94f-68c4c15ab527 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:30.218659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2683e995-956a-4a17-a94f-68c4c15ab527 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:30.232283 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-aa42ca02-81f2-482a-aa6c-d9774b892e53 req-06635c56-073d-4643-8aff-04853d853e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f71c7f-dd64-49e3-b9fe-5096584b8e66", "tag": "ce0ade64-627f-46d5-b735-2fa587d4c9e2"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:30.233953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:30.233953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:30.255344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-aa42ca02-81f2-482a-aa6c-d9774b892e53 req-06635c56-073d-4643-8aff-04853d853e13 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.256396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2683e995-956a-4a17-a94f-68c4c15ab527 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.256959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2683e995-956a-4a17-a94f-68c4c15ab527 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.257841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2683e995-956a-4a17-a94f-68c4c15ab527 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.260201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-aa42ca02-81f2-482a-aa6c-d9774b892e53 req-06635c56-073d-4643-8aff-04853d853e13 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.264257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2683e995-956a-4a17-a94f-68c4c15ab527 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.303305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-aa42ca02-81f2-482a-aa6c-d9774b892e53 req-06635c56-073d-4643-8aff-04853d853e13 service nova] Creating event network-changed:ce0ade64-627f-46d5-b735-2fa587d4c9e2 for instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 on hv-cinder-78447 Jan 19 16:25:30.314373 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-aa42ca02-81f2-482a-aa6c-d9774b892e53 req-06635c56-073d-4643-8aff-04853d853e13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085200 Jan 19 16:25:30.315902 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 69/142] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:25:30.415211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2683e995-956a-4a17-a94f-68c4c15ab527 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.208487 Jan 19 16:25:30.417019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 74/143] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:30 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:30.549052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:30.550473 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:30.570414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.573477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.576609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.578765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.756977 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:30.766689 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-deabd1cf-f490-42a6-923e-3a07e079a21b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1276 microversion: 2.1 time: 0.223710 Jan 19 16:25:30.775795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 70/144] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:30 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:30.796283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:30.801512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:30.818897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.830699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.832617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.838143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:30.980870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-efffe59d-c4b0-4361-8ef8-4c1dbb94d677 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:30.982242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-efffe59d-c4b0-4361-8ef8-4c1dbb94d677 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:30.997675 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efffe59d-c4b0-4361-8ef8-4c1dbb94d677 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:30.998909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efffe59d-c4b0-4361-8ef8-4c1dbb94d677 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.001572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efffe59d-c4b0-4361-8ef8-4c1dbb94d677 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.016816 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efffe59d-c4b0-4361-8ef8-4c1dbb94d677 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.152419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-efffe59d-c4b0-4361-8ef8-4c1dbb94d677 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.176895 Jan 19 16:25:31.155812 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 71/145] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:30 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:31.248165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:31.277431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e57afc39-ab51-4f5a-82ef-42c8f2edb0cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.491861 Jan 19 16:25:31.287587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 75/146] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:30 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:31.431098 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-32d9ec9f-34b5-468a-81b7-1d8b2f55201b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:31.432262 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-32d9ec9f-34b5-468a-81b7-1d8b2f55201b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:31.454304 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32d9ec9f-34b5-468a-81b7-1d8b2f55201b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.455042 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32d9ec9f-34b5-468a-81b7-1d8b2f55201b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.455932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32d9ec9f-34b5-468a-81b7-1d8b2f55201b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.456399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32d9ec9f-34b5-468a-81b7-1d8b2f55201b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.504756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:31.505685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:31.525078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.525721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.529541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.531223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.566484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] HTTP exception thrown: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. Jan 19 16:25:31.567418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Returning 404 to user: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:25:31.568502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bf142a90-4f0a-4290-9049-08127682a6ca tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "DELETE /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 404 len: 111 microversion: 2.1 time: 0.067938 Jan 19 16:25:31.569283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 76/147] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:25:31 2022] DELETE /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:25:31.577745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:31.578691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] [instance: 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:31.586764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.587852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.588968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.590739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.608452 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-32d9ec9f-34b5-468a-81b7-1d8b2f55201b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.182342 Jan 19 16:25:31.609898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 72/148] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:31 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:31.623192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] HTTP exception thrown: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. Jan 19 16:25:31.624078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] Returning 404 to user: Instance 546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:25:31.624934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-74dba0de-17bc-4309-bf3f-a45d643eb447 tempest-DeleteServersTestJSON-1938533149 tempest-DeleteServersTestJSON-1938533149-project] 10.222.0.42 "GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5" status: 404 len: 111 microversion: 2.1 time: 0.051003 Jan 19 16:25:31.625542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 77/149] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:31 2022] GET /compute/v2.1/servers/546f81a1-a3d9-404b-a4d6-4e5c4dc02fd5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:25:31.794271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:31.795345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:31.812270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.812640 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:31.813456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:31.813898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:32.165296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5f604d26-c13f-4975-b87d-85ad32cbd24c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:32.166285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5f604d26-c13f-4975-b87d-85ad32cbd24c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:32.179185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f604d26-c13f-4975-b87d-85ad32cbd24c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:32.179710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f604d26-c13f-4975-b87d-85ad32cbd24c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:32.188300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f604d26-c13f-4975-b87d-85ad32cbd24c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:32.192442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f604d26-c13f-4975-b87d-85ad32cbd24c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:32.319949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5f604d26-c13f-4975-b87d-85ad32cbd24c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.158709 Jan 19 16:25:32.321575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 78/150] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:32 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:32.340170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:32.341502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:32.374445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:32.375962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:32.377011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:32.388122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:33.104087 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:33.118786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9220d070-b178-45ad-951f-f0c4cbcddeca tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1318 microversion: 2.1 time: 1.328547 Jan 19 16:25:33.119583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 73/151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:31 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1318 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:33.124929 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fde5568a-44ed-4602-b334-a580836e8e9d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:33.125861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fde5568a-44ed-4602-b334-a580836e8e9d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:33.153341 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fde5568a-44ed-4602-b334-a580836e8e9d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:33.153790 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fde5568a-44ed-4602-b334-a580836e8e9d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:33.154651 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fde5568a-44ed-4602-b334-a580836e8e9d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:33.155207 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fde5568a-44ed-4602-b334-a580836e8e9d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:33.242728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fde5568a-44ed-4602-b334-a580836e8e9d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.120704 Jan 19 16:25:33.244683 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 74/152] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:33 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:33.341110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b39200b6-df04-4d37-a4e4-c2209d1e4abf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:33.343357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b39200b6-df04-4d37-a4e4-c2209d1e4abf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:33.353269 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39200b6-df04-4d37-a4e4-c2209d1e4abf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:33.354281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39200b6-df04-4d37-a4e4-c2209d1e4abf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:33.357584 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39200b6-df04-4d37-a4e4-c2209d1e4abf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:33.360517 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39200b6-df04-4d37-a4e4-c2209d1e4abf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:33.407050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:33.427823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0fe10438-2b3a-4dc1-b046-7b6eec90f412 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 1.102948 Jan 19 16:25:33.430183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 79/153] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:32 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:33.483959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b39200b6-df04-4d37-a4e4-c2209d1e4abf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 14 microversion: 2.20 time: 0.154146 Jan 19 16:25:33.493450 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 75/154] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:33 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:34.141690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:34.143272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:34.158588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.159652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.160659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.162188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.257149 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ad872343-d6d9-4507-a611-b3abe7c45510 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:34.258445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ad872343-d6d9-4507-a611-b3abe7c45510 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:34.271227 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad872343-d6d9-4507-a611-b3abe7c45510 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.272908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad872343-d6d9-4507-a611-b3abe7c45510 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.274316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad872343-d6d9-4507-a611-b3abe7c45510 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.274770 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad872343-d6d9-4507-a611-b3abe7c45510 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.415379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ad872343-d6d9-4507-a611-b3abe7c45510 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.160460 Jan 19 16:25:34.420220 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 76/155] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:34 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:25:34.432299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-e9ea2a7b-c347-4374-83b8-30f69567a215 req-3380540b-7a09-47ec-95ca-460b04a65a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44764317-b47f-45aa-b59a-f4d2c5bc0480", "tag": "45c123e8-df45-44e7-94a9-41f0b7c02a54"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:34.440872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:34.440872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:34.483272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-e9ea2a7b-c347-4374-83b8-30f69567a215 req-3380540b-7a09-47ec-95ca-460b04a65a42 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.483556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-e9ea2a7b-c347-4374-83b8-30f69567a215 req-3380540b-7a09-47ec-95ca-460b04a65a42 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.537420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-e9ea2a7b-c347-4374-83b8-30f69567a215 req-3380540b-7a09-47ec-95ca-460b04a65a42 service nova] Creating event network-changed:45c123e8-df45-44e7-94a9-41f0b7c02a54 for instance 44764317-b47f-45aa-b59a-f4d2c5bc0480 on hv-cinder-78447 Jan 19 16:25:34.556474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-e9ea2a7b-c347-4374-83b8-30f69567a215 req-3380540b-7a09-47ec-95ca-460b04a65a42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134275 Jan 19 16:25:34.560152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 77/156] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:34.571358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:34.572111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:34.579971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:34.593033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ecb48076-2491-4645-8c58-a377f6cc34be tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1318 microversion: 2.1 time: 0.457719 Jan 19 16:25:34.595439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.595936 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.596760 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.597566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 80/157] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:34 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:34.603802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.604759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5d58b693-530b-46ec-8864-7b68b78636fb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:34.606127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5d58b693-530b-46ec-8864-7b68b78636fb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:34.613081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d58b693-530b-46ec-8864-7b68b78636fb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.613925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d58b693-530b-46ec-8864-7b68b78636fb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.614881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d58b693-530b-46ec-8864-7b68b78636fb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:34.615408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d58b693-530b-46ec-8864-7b68b78636fb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:34.707048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5d58b693-530b-46ec-8864-7b68b78636fb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 9336 microversion: 2.20 time: 0.108072 Jan 19 16:25:34.707622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 81/158] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:34 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 9336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:25:34.953460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:34.964911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2e216b89-3ce9-4ce5-8719-d609d2b1cd24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.403288 Jan 19 16:25:34.975311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 78/159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:34 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:35.433408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d0e301d8-ac6e-4a9b-8223-5a62c54abb83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:35.442082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0e301d8-ac6e-4a9b-8223-5a62c54abb83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:35.465785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e301d8-ac6e-4a9b-8223-5a62c54abb83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:35.466492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e301d8-ac6e-4a9b-8223-5a62c54abb83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:35.470688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e301d8-ac6e-4a9b-8223-5a62c54abb83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:35.471466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e301d8-ac6e-4a9b-8223-5a62c54abb83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:35.613635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d0e301d8-ac6e-4a9b-8223-5a62c54abb83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.188434 Jan 19 16:25:35.614665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 82/160] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:35 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:35.615091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:35.615739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:35.625884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:35.626715 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:35.628267 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:35.629018 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:35.720520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4c11efb5-21a9-4d9a-926a-e7b2b8f4c4ca tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:35.721445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4c11efb5-21a9-4d9a-926a-e7b2b8f4c4ca tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:35.731438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c11efb5-21a9-4d9a-926a-e7b2b8f4c4ca tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:35.732472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c11efb5-21a9-4d9a-926a-e7b2b8f4c4ca tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:35.733966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c11efb5-21a9-4d9a-926a-e7b2b8f4c4ca tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:35.734887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c11efb5-21a9-4d9a-926a-e7b2b8f4c4ca tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:35.861177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4c11efb5-21a9-4d9a-926a-e7b2b8f4c4ca tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 15025 microversion: 2.20 time: 0.145505 Jan 19 16:25:35.862169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 83/161] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:35 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 15025 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:36.022246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fe6b6841-86b9-4040-9d1a-7ae692289c52 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Action: 'create', calling method: .version_select at 0x7f716c2b6040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1531245040", "metadata": {"Type": "work"}}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:36.041547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:36.050311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-68ca2106-7c19-46f6-8e38-4a3bb9927855 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1318 microversion: 2.1 time: 0.439033 Jan 19 16:25:36.062058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:35 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:36.069123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:36.070380 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:36.078330 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:36.079199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:36.080328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:36.081392 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:36.393919 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:36.409935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a546b453-cff4-460c-ac31-6152d5a234bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.346141 Jan 19 16:25:36.414327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 80/163] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:36 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:36.579992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fe6b6841-86b9-4040-9d1a-7ae692289c52 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.716190 Jan 19 16:25:36.580587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 84/164] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jan 19 16:25:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 718 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 19 16:25:36.596556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0dbe0cce-39b1-4dc3-b68b-93fa6c021d38 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Calling method '.version_select at 0x7f716c2eeaf0>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:36.627287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b0918856-7379-4b4a-a96d-2d70c2483265 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:36.628645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b0918856-7379-4b4a-a96d-2d70c2483265 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:36.644135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0918856-7379-4b4a-a96d-2d70c2483265 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:36.644653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0918856-7379-4b4a-a96d-2d70c2483265 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:36.645769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0918856-7379-4b4a-a96d-2d70c2483265 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:36.646371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0918856-7379-4b4a-a96d-2d70c2483265 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:36.683933 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0dbe0cce-39b1-4dc3-b68b-93fa6c021d38 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7" status: 200 len: 353 microversion: 2.1 time: 0.090755 Jan 19 16:25:36.685647 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 81/165] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:25:36 2022] GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:36.730532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b0918856-7379-4b4a-a96d-2d70c2483265 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.106786 Jan 19 16:25:36.731183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 85/166] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:36 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:25:36.873872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8f7be769-68a8-4b27-a5e4-225bc649d740 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:36.874917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8f7be769-68a8-4b27-a5e4-225bc649d740 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:36.882513 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8f7be769-68a8-4b27-a5e4-225bc649d740 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:36.883803 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8f7be769-68a8-4b27-a5e4-225bc649d740 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:36.884855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8f7be769-68a8-4b27-a5e4-225bc649d740 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:36.885591 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8f7be769-68a8-4b27-a5e4-225bc649d740 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:36.986532 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8f7be769-68a8-4b27-a5e4-225bc649d740 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 18208 microversion: 2.20 time: 0.116358 Jan 19 16:25:36.990737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 82/167] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:36 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 18208 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:37.068645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:37.069358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:37.081372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:37.081838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:37.082655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:37.083098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:37.269563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:37.285798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7c8bc7cb-bd83-43e4-a095-da8a14c9f395 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1318 microversion: 2.1 time: 0.221709 Jan 19 16:25:37.287855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 86/168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:37 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:37.447593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:37.449926 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:37.475401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:37.480451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:37.481610 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:37.482259 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:37.705663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-69f28539-4b89-484e-ada9-c945f0cd48a9 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Calling method '.version_select at 0x7f716c357c10>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:37.789318 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:37.806004 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d61b4f65-15df-4a69-81a4-9768ae87d696 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.370532 Jan 19 16:25:37.807229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 83/169] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:37 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:37.816667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-82231022-a40d-4dfb-ae59-faec455d543c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:37.819041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-82231022-a40d-4dfb-ae59-faec455d543c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:37.832116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82231022-a40d-4dfb-ae59-faec455d543c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:37.833359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82231022-a40d-4dfb-ae59-faec455d543c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:37.834875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82231022-a40d-4dfb-ae59-faec455d543c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:37.835844 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82231022-a40d-4dfb-ae59-faec455d543c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:37.937119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-69f28539-4b89-484e-ada9-c945f0cd48a9 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7" status: 200 len: 354 microversion: 2.1 time: 0.237912 Jan 19 16:25:37.937729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 87/170] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:25:37 2022] GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:37.953416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-82231022-a40d-4dfb-ae59-faec455d543c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.142484 Jan 19 16:25:37.958607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7b1941f0-6447-4233-93a6-67efdefacfc8 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Calling method '.version_select at 0x7f716d7f8430>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:37.959908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 84/171] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:37 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:38.005531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e3f7a26b-50ba-44b5-9e6a-93698a63025b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:38.007862 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e3f7a26b-50ba-44b5-9e6a-93698a63025b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:38.021696 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e3f7a26b-50ba-44b5-9e6a-93698a63025b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.022866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e3f7a26b-50ba-44b5-9e6a-93698a63025b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:38.024222 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e3f7a26b-50ba-44b5-9e6a-93698a63025b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.024974 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e3f7a26b-50ba-44b5-9e6a-93698a63025b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:38.115149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7b1941f0-6447-4233-93a6-67efdefacfc8 tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7" status: 200 len: 354 microversion: 2.1 time: 0.160463 Jan 19 16:25:38.116667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 88/172] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:25:37 2022] GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:38.137696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-07486d2f-3f91-4233-926e-5c3ff3cf6b9f tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Calling method '.version_select at 0x7f716d7f8550>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:38.137953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e3f7a26b-50ba-44b5-9e6a-93698a63025b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 19226 microversion: 2.20 time: 0.141029 Jan 19 16:25:38.143570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 85/173] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:37 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 19226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:25:38.236657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-07486d2f-3f91-4233-926e-5c3ff3cf6b9f tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7" status: 202 len: 0 microversion: 2.1 time: 0.104236 Jan 19 16:25:38.238038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 89/174] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jan 19 16:25:38 2022] DELETE /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:38.247314 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bc9711cc-253d-4aae-b752-1ad50a77a24c tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Calling method '.version_select at 0x7f716c357dc0>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:38.312552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:38.313768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:38.324336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bc9711cc-253d-4aae-b752-1ad50a77a24c tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7" status: 200 len: 353 microversion: 2.1 time: 0.081250 Jan 19 16:25:38.325914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 86/175] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:25:38 2022] GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:25:38.327782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.328563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:38.329843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.330259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:38.565551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:38.578835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9de74d84-f6d3-4750-a18e-948a2b89b7eb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1318 microversion: 2.1 time: 0.274651 Jan 19 16:25:38.579565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 90/176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:38 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:38.837891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:38.839579 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:38.853388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.854849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:38.855926 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.856894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:38.972777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-da4b0fc1-1657-4c33-ac86-6851ad47a0f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:38.976012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-da4b0fc1-1657-4c33-ac86-6851ad47a0f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:38.992626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da4b0fc1-1657-4c33-ac86-6851ad47a0f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.993987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da4b0fc1-1657-4c33-ac86-6851ad47a0f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:38.995709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da4b0fc1-1657-4c33-ac86-6851ad47a0f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:38.996839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da4b0fc1-1657-4c33-ac86-6851ad47a0f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:39.075393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:39.090142 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6137dc55-507b-467b-a41e-90ec35692283 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.259856 Jan 19 16:25:39.091609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 87/177] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:38 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:39.102919 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-bd38f8cd-51a0-46ef-bbec-ba03758c9025 req-b1b15ad2-800e-496b-9458-6d8d6f65c025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44764317-b47f-45aa-b59a-f4d2c5bc0480", "name": "network-vif-plugged", "status": "completed", "tag": "45c123e8-df45-44e7-94a9-41f0b7c02a54"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:39.107156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:39.107156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:39.114761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-da4b0fc1-1657-4c33-ac86-6851ad47a0f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.149617 Jan 19 16:25:39.116699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 91/178] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:38 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:39.129081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-bd38f8cd-51a0-46ef-bbec-ba03758c9025 req-b1b15ad2-800e-496b-9458-6d8d6f65c025 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:39.129684 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-bd38f8cd-51a0-46ef-bbec-ba03758c9025 req-b1b15ad2-800e-496b-9458-6d8d6f65c025 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:39.149284 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-bd38f8cd-51a0-46ef-bbec-ba03758c9025 req-b1b15ad2-800e-496b-9458-6d8d6f65c025 service nova] Creating event network-vif-plugged:45c123e8-df45-44e7-94a9-41f0b7c02a54 for instance 44764317-b47f-45aa-b59a-f4d2c5bc0480 on hv-cinder-78447 Jan 19 16:25:39.159606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d34db974-4fba-49da-af10-c3b3aa867d68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:39.164413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d34db974-4fba-49da-af10-c3b3aa867d68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:39.164579 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-bd38f8cd-51a0-46ef-bbec-ba03758c9025 req-b1b15ad2-800e-496b-9458-6d8d6f65c025 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067555 Jan 19 16:25:39.166253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 88/179] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:39.179458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d34db974-4fba-49da-af10-c3b3aa867d68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:39.180745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d34db974-4fba-49da-af10-c3b3aa867d68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:39.182874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d34db974-4fba-49da-af10-c3b3aa867d68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:39.184232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d34db974-4fba-49da-af10-c3b3aa867d68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:39.323501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d34db974-4fba-49da-af10-c3b3aa867d68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 20991 microversion: 2.20 time: 0.174661 Jan 19 16:25:39.324285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 92/180] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:39 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 20991 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:39.348541 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a23fadf4-6d4c-44a5-8407-1bbfeb78e10f tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Calling method '.version_select at 0x7f716c30b280>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:39.406858 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.wsgi [None req-a23fadf4-6d4c-44a5-8407-1bbfeb78e10f tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] HTTP exception thrown: Volume c4f25f4b-a8fe-4433-808b-8670128463b7 could not be found. Jan 19 16:25:39.407943 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a23fadf4-6d4c-44a5-8407-1bbfeb78e10f tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] Returning 404 to user: Volume c4f25f4b-a8fe-4433-808b-8670128463b7 could not be found. {{(pid=116209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:25:39.409464 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a23fadf4-6d4c-44a5-8407-1bbfeb78e10f tempest-VolumesGetTestJSON-1215206428 tempest-VolumesGetTestJSON-1215206428-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7" status: 404 len: 109 microversion: 2.1 time: 0.071051 Jan 19 16:25:39.410839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 89/181] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:25:39 2022] GET /compute/v2.1/os-volumes/c4f25f4b-a8fe-4433-808b-8670128463b7 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:25:39.621775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:39.623492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:39.641156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:39.642610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:39.644345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:39.645639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:40.133123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:40.135307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:40.145780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:40.146601 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:40.148125 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:40.148963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:40.290295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:40.306212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-307936f0-fa55-4ebb-8969-4ca00a62dd98 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1318 microversion: 2.1 time: 0.703661 Jan 19 16:25:40.307709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 93/182] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:39 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1318 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:40.317079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-68a940f0-bc2a-4ca0-9a6a-c1fdc5c93786 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:40.320252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-68a940f0-bc2a-4ca0-9a6a-c1fdc5c93786 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:40.336808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a940f0-bc2a-4ca0-9a6a-c1fdc5c93786 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:40.338982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a940f0-bc2a-4ca0-9a6a-c1fdc5c93786 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:40.340859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a940f0-bc2a-4ca0-9a6a-c1fdc5c93786 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:40.341646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a940f0-bc2a-4ca0-9a6a-c1fdc5c93786 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:40.552841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:40.561595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fe8bccf2-cf0d-4c1d-87c6-413a51df550e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.440400 Jan 19 16:25:40.571317 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 90/183] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:40 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:40.576277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2b52169f-adff-4028-91c2-08a2941cba1b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:40.577226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2b52169f-adff-4028-91c2-08a2941cba1b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:40.583894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b52169f-adff-4028-91c2-08a2941cba1b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:40.584723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b52169f-adff-4028-91c2-08a2941cba1b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:40.586563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b52169f-adff-4028-91c2-08a2941cba1b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:40.587205 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b52169f-adff-4028-91c2-08a2941cba1b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:40.613960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-68a940f0-bc2a-4ca0-9a6a-c1fdc5c93786 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.303464 Jan 19 16:25:40.616218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 94/184] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:40 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:40.697249 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2b52169f-adff-4028-91c2-08a2941cba1b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 22891 microversion: 2.20 time: 0.123010 Jan 19 16:25:40.698140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 91/185] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:40 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 22891 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:41.328031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:41.329333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:41.341835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:41.343560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:41.346295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:41.346942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:41.580196 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:41.581546 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:41.592913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:41.593690 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:41.595396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:41.596042 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:41.946191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:41.984872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-57ccc4d9-643c-4126-b394-91ece8f15860 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1318 microversion: 2.1 time: 0.662373 Jan 19 16:25:41.990364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 95/186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:41 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:42.017110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b83f0fbe-ef97-4a45-9151-5f9be32cdf1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:42.024561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b83f0fbe-ef97-4a45-9151-5f9be32cdf1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:42.049201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b83f0fbe-ef97-4a45-9151-5f9be32cdf1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:42.049868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b83f0fbe-ef97-4a45-9151-5f9be32cdf1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:42.050827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b83f0fbe-ef97-4a45-9151-5f9be32cdf1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:42.051507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b83f0fbe-ef97-4a45-9151-5f9be32cdf1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:42.053394 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:42.063626 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0da214ae-6bc8-4838-ade5-226f22b16f0f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1520 microversion: 2.1 time: 0.487628 Jan 19 16:25:42.064573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 92/187] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:41 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:42.070494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ff867825-9679-4620-814e-a138ed327309 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:42.070916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ff867825-9679-4620-814e-a138ed327309 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:42.077905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ff867825-9679-4620-814e-a138ed327309 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:42.079300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ff867825-9679-4620-814e-a138ed327309 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:42.080291 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ff867825-9679-4620-814e-a138ed327309 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:42.080859 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ff867825-9679-4620-814e-a138ed327309 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:42.186550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ff867825-9679-4620-814e-a138ed327309 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 23957 microversion: 2.20 time: 0.120244 Jan 19 16:25:42.189325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 93/188] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:42 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 23957 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:42.197138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b83f0fbe-ef97-4a45-9151-5f9be32cdf1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 14 microversion: 2.1 time: 0.192367 Jan 19 16:25:42.201118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 96/189] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:41 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:43.013374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:43.014731 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:43.027833 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.029016 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.030744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.032118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.089105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:43.090092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:43.103408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.103932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.106676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.110164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.345451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:43.364878 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e46c4232-1170-46d6-a782-99ffba7a7857 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1509 microversion: 2.1 time: 0.359026 Jan 19 16:25:43.367159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 94/190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:43 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:43.401811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d9351839-4b79-4212-a035-c9925d1c9a2c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:43.402905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:43.404889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d9351839-4b79-4212-a035-c9925d1c9a2c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:43.415601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-90d7c419-d5df-40ca-8e7f-6b7237e59523 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1500 microversion: 2.1 time: 0.329251 Jan 19 16:25:43.427715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 97/191] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:43 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:43.427715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d030186c-bf95-4ffe-acde-3cad15045713 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:43.430124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d030186c-bf95-4ffe-acde-3cad15045713 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:43.439622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d030186c-bf95-4ffe-acde-3cad15045713 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.442784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d030186c-bf95-4ffe-acde-3cad15045713 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.444442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d030186c-bf95-4ffe-acde-3cad15045713 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.446277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9351839-4b79-4212-a035-c9925d1c9a2c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.447400 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9351839-4b79-4212-a035-c9925d1c9a2c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.448018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d030186c-bf95-4ffe-acde-3cad15045713 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.450279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9351839-4b79-4212-a035-c9925d1c9a2c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.452352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9351839-4b79-4212-a035-c9925d1c9a2c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.547628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d030186c-bf95-4ffe-acde-3cad15045713 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 9182 microversion: 2.1 time: 0.128937 Jan 19 16:25:43.548749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 98/192] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:43 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 9182 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:43.563066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9600b358-62b0-4015-a2b1-5b018836f2ea"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:43.564521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:43.590293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d9351839-4b79-4212-a035-c9925d1c9a2c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 25409 microversion: 2.20 time: 0.220302 Jan 19 16:25:43.598215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 95/193] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:43 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 25409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:43.611736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:43.616011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.617401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:43.618814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.625568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.626165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.654418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.655156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.658571 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:43.659635 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:43.958593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] HTTP exception thrown: Invalid volume: volume 9600b358-62b0-4015-a2b1-5b018836f2ea is already attached to instances: d8891777-99d7-4d44-a6a7-60945ddd6ab2 Jan 19 16:25:43.963822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Returning 400 to user: Invalid volume: volume 9600b358-62b0-4015-a2b1-5b018836f2ea is already attached to instances: d8891777-99d7-4d44-a6a7-60945ddd6ab2 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:25:43.965392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5db8c44e-6b93-40fd-9ad4-8472bb6c2379 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.414618 Jan 19 16:25:43.974701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 99/194] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:25:43 2022] POST /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480/os-volume_attachments => generated 174 bytes in 425 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:25:43.996259 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:44.009293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-453ed727-c4ca-4936-9925-de6c531f2172 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1515 microversion: 2.1 time: 0.407243 Jan 19 16:25:44.009956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 96/195] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:44.073747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:44.079109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:44.106709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:44.107466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:44.108487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:44.115560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:44.569276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-92612977-9943-4de1-8bb7-e8ea08983587 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:44.578801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-92612977-9943-4de1-8bb7-e8ea08983587 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:44.605311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92612977-9943-4de1-8bb7-e8ea08983587 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:44.606283 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92612977-9943-4de1-8bb7-e8ea08983587 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:44.615208 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92612977-9943-4de1-8bb7-e8ea08983587 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:44.616460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92612977-9943-4de1-8bb7-e8ea08983587 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:44.754955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lazy-loading 'services' on Instance uuid d8891777-99d7-4d44-a6a7-60945ddd6ab2 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:25:44.767328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-92612977-9943-4de1-8bb7-e8ea08983587 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 15025 microversion: 2.1 time: 0.207600 Jan 19 16:25:44.768562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 97/196] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:44 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 15025 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:25:44.776262 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d93be224-e80d-4323-9190-db9326b5c197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:44.777928 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d93be224-e80d-4323-9190-db9326b5c197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:44.790254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d93be224-e80d-4323-9190-db9326b5c197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:44.790710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d93be224-e80d-4323-9190-db9326b5c197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:44.792480 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d93be224-e80d-4323-9190-db9326b5c197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:44.793189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d93be224-e80d-4323-9190-db9326b5c197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:44.908271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d93be224-e80d-4323-9190-db9326b5c197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 26472 microversion: 2.20 time: 0.137128 Jan 19 16:25:44.909204 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 98/197] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:44 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 26472 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:45.041741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-02fc8763-3dc0-48a0-be71-a8adf732154d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments/9600b358-62b0-4015-a2b1-5b018836f2ea" status: 202 len: 0 microversion: 2.1 time: 0.974105 Jan 19 16:25:45.043035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 100/198] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:25:44 2022] DELETE /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments/9600b358-62b0-4015-a2b1-5b018836f2ea => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:45.059613 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-44647a14-0c99-4d8c-ab74-9dcd8c8eddc1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:45.069813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-44647a14-0c99-4d8c-ab74-9dcd8c8eddc1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:45.113609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44647a14-0c99-4d8c-ab74-9dcd8c8eddc1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.116165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44647a14-0c99-4d8c-ab74-9dcd8c8eddc1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:45.117870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44647a14-0c99-4d8c-ab74-9dcd8c8eddc1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.118752 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44647a14-0c99-4d8c-ab74-9dcd8c8eddc1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:45.223160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-44647a14-0c99-4d8c-ab74-9dcd8c8eddc1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174728 Jan 19 16:25:45.224860 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 99/199] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:25:45 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:45.788263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c4690423-0358-4c19-9ff2-3a4660ffb146 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:45.789662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c4690423-0358-4c19-9ff2-3a4660ffb146 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:45.799200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4690423-0358-4c19-9ff2-3a4660ffb146 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.799704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4690423-0358-4c19-9ff2-3a4660ffb146 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:45.801299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4690423-0358-4c19-9ff2-3a4660ffb146 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.802006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4690423-0358-4c19-9ff2-3a4660ffb146 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:45.924029 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f5bf4349-be5d-4d9b-9f95-2967af0b14eb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:45.925267 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f5bf4349-be5d-4d9b-9f95-2967af0b14eb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:45.937708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c4690423-0358-4c19-9ff2-3a4660ffb146 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 17834 microversion: 2.1 time: 0.156365 Jan 19 16:25:45.942145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 101/200] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:45 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 17834 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:25:45.944062 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5bf4349-be5d-4d9b-9f95-2967af0b14eb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.944529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5bf4349-be5d-4d9b-9f95-2967af0b14eb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:45.945400 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5bf4349-be5d-4d9b-9f95-2967af0b14eb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.945850 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5bf4349-be5d-4d9b-9f95-2967af0b14eb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:45.957807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:45.961693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:45.980047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.983735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:45.986219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:45.988615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:46.061705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lazy-loading 'flavor' on Instance uuid e119b741-b721-47fa-a03f-be8689acf2fd {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:25:46.078590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f5bf4349-be5d-4d9b-9f95-2967af0b14eb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 27149 microversion: 2.20 time: 0.159252 Jan 19 16:25:46.083445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 100/201] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:45 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 27149 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:25:46.254139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-62765654-eacd-4d76-bcae-dd9fddb50895 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:46.264983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-62765654-eacd-4d76-bcae-dd9fddb50895 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:46.318054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9d0538c2-bec9-4190-8596-f2002977a437 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action" status: 200 len: 32 microversion: 2.1 time: 0.369962 Jan 19 16:25:46.325468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62765654-eacd-4d76-bcae-dd9fddb50895 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:46.330078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 102/202] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:45 2022] POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action => generated 32 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:25:46.330768 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62765654-eacd-4d76-bcae-dd9fddb50895 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:46.332353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62765654-eacd-4d76-bcae-dd9fddb50895 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:46.333181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62765654-eacd-4d76-bcae-dd9fddb50895 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:46.337621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:46.345746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:46.355002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:46.355919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:46.357165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:46.358073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:46.497601 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-62765654-eacd-4d76-bcae-dd9fddb50895 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.261008 Jan 19 16:25:46.506326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 101/203] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:25:46 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2/os-volume_attachments => generated 25 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:25:46.608390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-566848695", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "61c752aa-bbe8-44e6-8f2f-8f5fe9557f72"}]}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:46.627946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:46.630181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3420a06a-de01-477f-976c-5fbf5ef8b6f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.298125 Jan 19 16:25:46.645429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 103/204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:46.724355 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.network.neutron [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] validate_networks() for [('61c752aa-bbe8-44e6-8f2f-8f5fe9557f72', None, None, None, None, None)] {{(pid=116209) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:25:46.811220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-638490948", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "d8b0d303-631a-44be-8091-f10b96ec14c3"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:46.937249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] validate_networks() for [('d8b0d303-631a-44be-8091-f10b96ec14c3', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:25:47.615924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Flavor limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:25:47.617351 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Image limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:25:47.618072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Flavor pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:25:47.618635 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Image pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:25:47.619246 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:25:47.652162 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:47.653148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:47.655574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:47.656441 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:47.683553 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Getting quotas for project 1aa2c73bd1cb4a0bb7fbb2b583473256. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:25:47.693022 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Getting quotas for user 842191a2a2f94550aa4427649656ed38 and project 1aa2c73bd1cb4a0bb7fbb2b583473256. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:25:47.723524 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Going to run 1 instances... {{(pid=116209) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:25:47.728404 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:25:47.843298 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-932715f7-ecee-4e22-8120-5bc36e37558f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235756 Jan 19 16:25:47.850671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 102/205] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 16:25:47.870917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a360a9c2-c9a4-46d3-939c-e66bb79d48c0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:47.879968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a360a9c2-c9a4-46d3-939c-e66bb79d48c0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:47.910250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a360a9c2-c9a4-46d3-939c-e66bb79d48c0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:47.912399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a360a9c2-c9a4-46d3-939c-e66bb79d48c0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:47.915093 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a360a9c2-c9a4-46d3-939c-e66bb79d48c0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:47.915962 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a360a9c2-c9a4-46d3-939c-e66bb79d48c0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.007273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:25:48.012464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:25:48.012841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:25:48.013256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:25:48.013670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:25:48.035845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.039066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.047225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.048515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.050041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a360a9c2-c9a4-46d3-939c-e66bb79d48c0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 20991 microversion: 2.1 time: 0.197290 Jan 19 16:25:48.058666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 103/206] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:47 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 20991 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:25:48.063582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-074737a0-bc4b-4eba-a161-2d742308a99f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:48.064694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-074737a0-bc4b-4eba-a161-2d742308a99f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:48.076874 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-074737a0-bc4b-4eba-a161-2d742308a99f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.077353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-074737a0-bc4b-4eba-a161-2d742308a99f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.078172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-074737a0-bc4b-4eba-a161-2d742308a99f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.079419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-074737a0-bc4b-4eba-a161-2d742308a99f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.111391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:25:48.116205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for user 9b66fbdfc39840b2962c8d7686098903 and project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:25:48.131545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:25:48.136272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:25:48.210003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6ad586b-5f7d-4dd6-b9b6-e5dd25156842 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408813 Jan 19 16:25:48.215939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 104/207] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:25:48.230080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:48.231553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:48.245790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.248325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.249775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.250450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.549443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:48.559424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5ca6bf9e-b20d-4a01-a858-144038df218c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.339592 Jan 19 16:25:48.561114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 105/208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:48.581428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:48.583177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:48.597780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.598949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.600619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:48.602155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:48.714592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:48.723566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-218474a5-7b00-4489-b27a-c21d48674115 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1222 microversion: 2.1 time: 0.160281 Jan 19 16:25:48.724239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 106/209] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:48 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:48.730019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76b9d133-8ae3-4dc5-b5c1-9848b7459518 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:48.730730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76b9d133-8ae3-4dc5-b5c1-9848b7459518 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:48.807048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-76b9d133-8ae3-4dc5-b5c1-9848b7459518 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:48.817381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76b9d133-8ae3-4dc5-b5c1-9848b7459518 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1217 microversion: 2.1 time: 0.091946 Jan 19 16:25:48.818191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 107/210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:48 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:49.062928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a61bc902-8428-4f1b-9b9c-651324b49494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:49.064109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a61bc902-8428-4f1b-9b9c-651324b49494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:49.074386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a61bc902-8428-4f1b-9b9c-651324b49494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:49.075208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a61bc902-8428-4f1b-9b9c-651324b49494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:49.076517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a61bc902-8428-4f1b-9b9c-651324b49494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:49.077179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a61bc902-8428-4f1b-9b9c-651324b49494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:51.036484 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-074737a0-bc4b-4eba-a161-2d742308a99f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 27846 microversion: 2.20 time: 2.977819 Jan 19 16:25:51.041621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 104/211] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:48 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 27846 bytes in 2985 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:51.047315 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:51.048051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:51.056963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:51.057415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:51.058677 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:51.059299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:51.132124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a61bc902-8428-4f1b-9b9c-651324b49494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 24266 microversion: 2.1 time: 2.072746 Jan 19 16:25:51.134797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 108/212] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:49 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 24266 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:25:51.151862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:51.155821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:51.168896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:51.170128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:51.172276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:51.173429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:51.339326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:51.356985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c66af22c-7421-47eb-80cc-ac37be839c2d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1222 microversion: 2.1 time: 0.219667 Jan 19 16:25:51.358586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 109/213] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:51 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1222 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:51.369594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:51.373163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:51.390457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:51.390974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:51.391775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:51.392224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:51.404325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:51.447795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-077c0bb8-6b10-4a06-849c-664a2c403c01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.401276 Jan 19 16:25:51.449230 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 105/214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:51.569027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:51.586380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c9f4c517-02c2-40b7-a3b7-27787033043d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1213 microversion: 2.1 time: 0.225269 Jan 19 16:25:51.587204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 110/215] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:51 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:52.057080 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f94237ba-f534-4903-b29a-2c0f5c6709b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:52.061294 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f94237ba-f534-4903-b29a-2c0f5c6709b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:52.115605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f94237ba-f534-4903-b29a-2c0f5c6709b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.116861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f94237ba-f534-4903-b29a-2c0f5c6709b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.118383 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f94237ba-f534-4903-b29a-2c0f5c6709b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.119017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f94237ba-f534-4903-b29a-2c0f5c6709b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.148888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-31e738a1-e42c-4b72-84b0-3360e1f037d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:52.150574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-31e738a1-e42c-4b72-84b0-3360e1f037d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:52.162708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31e738a1-e42c-4b72-84b0-3360e1f037d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.163814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31e738a1-e42c-4b72-84b0-3360e1f037d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.166243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31e738a1-e42c-4b72-84b0-3360e1f037d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.168730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31e738a1-e42c-4b72-84b0-3360e1f037d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.272383 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f94237ba-f534-4903-b29a-2c0f5c6709b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28140 microversion: 2.20 time: 0.221479 Jan 19 16:25:52.274179 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 106/216] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:52 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28140 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:52.326239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-31e738a1-e42c-4b72-84b0-3360e1f037d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 25125 microversion: 2.1 time: 0.178694 Jan 19 16:25:52.334580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 111/217] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:52 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 25125 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:25:52.397256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:52.402085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:52.420693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.422309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.423943 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.424550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.477033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:52.477928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:52.496058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.496509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.504082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.505290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.529388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:52.543340 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a1ed6a20-7e7d-4919-8461-6577febe04ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1276 microversion: 2.1 time: 0.159180 Jan 19 16:25:52.546786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 107/218] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:52 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:52.614072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:52.614669 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:52.622763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.623712 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.624675 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:52.625261 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:52.791863 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:52.807322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-73411875-ab26-435d-b5da-1e412dc2b85b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1275 microversion: 2.1 time: 0.196777 Jan 19 16:25:52.808793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 108/219] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:52 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:53.021802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:53.040407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-01f4dddd-d158-47a4-bd6d-1fd3060dc9f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.573120 Jan 19 16:25:53.042093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 112/220] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:53.292778 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-606f801a-0864-47e5-ad57-e79eef16ba9c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:53.295394 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-606f801a-0864-47e5-ad57-e79eef16ba9c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:53.307104 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-606f801a-0864-47e5-ad57-e79eef16ba9c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:53.308348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-606f801a-0864-47e5-ad57-e79eef16ba9c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:53.310421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-606f801a-0864-47e5-ad57-e79eef16ba9c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:53.312617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-606f801a-0864-47e5-ad57-e79eef16ba9c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:53.343563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2c267f63-71da-4ae0-b967-caf727be4e93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:53.345337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2c267f63-71da-4ae0-b967-caf727be4e93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:53.360381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c267f63-71da-4ae0-b967-caf727be4e93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:53.361257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c267f63-71da-4ae0-b967-caf727be4e93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:53.362245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c267f63-71da-4ae0-b967-caf727be4e93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:53.362853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c267f63-71da-4ae0-b967-caf727be4e93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:55.824785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-606f801a-0864-47e5-ad57-e79eef16ba9c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28140 microversion: 2.20 time: 2.540092 Jan 19 16:25:55.826575 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 109/221] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:53 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28140 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:25:55.855245 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:55.858037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:55.872188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2c267f63-71da-4ae0-b967-caf727be4e93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 27497 microversion: 2.1 time: 2.533736 Jan 19 16:25:55.872997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 113/222] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:53 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 27497 bytes in 2536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:25:55.880802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:55.881628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:55.882672 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:55.884014 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:55.885078 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:55.888266 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:55.898841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:55.899216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:55.900088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:55.902880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:56.347226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:56.353797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:56.369484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-235914f4-003c-4869-ba3c-2896fcec1027 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.494848 Jan 19 16:25:56.371368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 114/223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:55 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:56.376925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-85a921aa-9dd7-4ebe-9f40-0fb8bd1626fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.547860 Jan 19 16:25:56.389114 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 110/224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:55 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:56.401739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:56.403222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:56.419270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:56.420521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:56.422442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:56.423513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:56.760310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:56.774981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f2c1d9e5-800a-408f-af7f-db670b4d07cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.401348 Jan 19 16:25:56.776903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 115/225] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:56.845656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ed4fda89-101f-49c9-99f7-b59aec4c254b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:56.853953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ed4fda89-101f-49c9-99f7-b59aec4c254b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:56.883745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4fda89-101f-49c9-99f7-b59aec4c254b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:56.884445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4fda89-101f-49c9-99f7-b59aec4c254b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:56.885300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4fda89-101f-49c9-99f7-b59aec4c254b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:56.888300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4fda89-101f-49c9-99f7-b59aec4c254b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:56.895709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ef905b88-561a-47b4-801c-411ce16dc9ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:56.908068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ef905b88-561a-47b4-801c-411ce16dc9ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:56.947378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef905b88-561a-47b4-801c-411ce16dc9ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:56.952428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef905b88-561a-47b4-801c-411ce16dc9ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:56.962079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef905b88-561a-47b4-801c-411ce16dc9ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:56.964078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef905b88-561a-47b4-801c-411ce16dc9ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:57.010703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ed4fda89-101f-49c9-99f7-b59aec4c254b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28140 microversion: 2.20 time: 0.174511 Jan 19 16:25:57.011392 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 111/226] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:56 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28140 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:57.201052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ef905b88-561a-47b4-801c-411ce16dc9ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 27737 microversion: 2.1 time: 0.314015 Jan 19 16:25:57.202081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 116/227] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:56 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 27737 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:25:57.249728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-f141828a-e10a-4df5-b9a1-538ca7b9528e req-f7bbc5a6-a685-4dcf-ac49-3170b2335e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c468c7-0274-4ef8-97d8-8569a4e123b3", "tag": "16baa7f0-2118-4683-91f3-22df6226182a"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:57.253182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:57.253182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:25:57.257025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-b96e2949-fa80-43e2-a7c8-f197deb8193c req-5b5d8d4e-657a-4be1-89ec-2255c3dbdec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda15853-ef18-40f3-9063-9e714ebd9a12", "tag": "02b33aa9-3f6d-484d-b8ed-49177f61589f"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:57.259564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:25:57.259564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:25:57.279659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-b96e2949-fa80-43e2-a7c8-f197deb8193c req-5b5d8d4e-657a-4be1-89ec-2255c3dbdec3 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:57.280619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-b96e2949-fa80-43e2-a7c8-f197deb8193c req-5b5d8d4e-657a-4be1-89ec-2255c3dbdec3 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:57.289276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-f141828a-e10a-4df5-b9a1-538ca7b9528e req-f7bbc5a6-a685-4dcf-ac49-3170b2335e0d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:57.290172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-f141828a-e10a-4df5-b9a1-538ca7b9528e req-f7bbc5a6-a685-4dcf-ac49-3170b2335e0d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:57.301567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-b96e2949-fa80-43e2-a7c8-f197deb8193c req-5b5d8d4e-657a-4be1-89ec-2255c3dbdec3 service nova] Creating event network-changed:02b33aa9-3f6d-484d-b8ed-49177f61589f for instance eda15853-ef18-40f3-9063-9e714ebd9a12 on hv-cinder-78447 Jan 19 16:25:57.308748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-b96e2949-fa80-43e2-a7c8-f197deb8193c req-5b5d8d4e-657a-4be1-89ec-2255c3dbdec3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056825 Jan 19 16:25:57.310249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 117/228] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:57.313146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-f141828a-e10a-4df5-b9a1-538ca7b9528e req-f7bbc5a6-a685-4dcf-ac49-3170b2335e0d service nova] Creating event network-changed:16baa7f0-2118-4683-91f3-22df6226182a for instance f8c468c7-0274-4ef8-97d8-8569a4e123b3 on hv-cinder-78447 Jan 19 16:25:57.321060 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-f141828a-e10a-4df5-b9a1-538ca7b9528e req-f7bbc5a6-a685-4dcf-ac49-3170b2335e0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077541 Jan 19 16:25:57.321988 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 112/229] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:25:57.392071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:57.393412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:57.408097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:57.409515 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:57.419973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:57.422887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:57.427653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:57.430892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:57.433515 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:57.434909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:57.438689 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:57.440041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:58.159560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:58.186297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1002d3e2-095f-4f5b-823c-d2dcc23eee8d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.800155 Jan 19 16:25:58.187203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 118/230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:57 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:58.191879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:58.197867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:58.216179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:58.216962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:58.217956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:58.218551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:58.520051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:58.531727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dca96e45-4659-4875-9208-ca46ef49d317 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 1.129022 Jan 19 16:25:58.532557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:57 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:25:58.564620 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a4d23708-4170-4c8d-ad97-17a3733b3e6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:58.566029 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a4d23708-4170-4c8d-ad97-17a3733b3e6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:58.573580 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4d23708-4170-4c8d-ad97-17a3733b3e6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:58.574323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4d23708-4170-4c8d-ad97-17a3733b3e6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:58.575348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4d23708-4170-4c8d-ad97-17a3733b3e6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:58.576875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4d23708-4170-4c8d-ad97-17a3733b3e6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:58.692947 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a4d23708-4170-4c8d-ad97-17a3733b3e6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28427 microversion: 2.20 time: 0.149317 Jan 19 16:25:58.694100 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 114/232] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:58 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28427 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:58.700988 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fbf6eaa1-6484-4830-9eb1-b0e99293f140 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:58.702719 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fbf6eaa1-6484-4830-9eb1-b0e99293f140 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:58.712503 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fbf6eaa1-6484-4830-9eb1-b0e99293f140 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:58.713229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fbf6eaa1-6484-4830-9eb1-b0e99293f140 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:58.714586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fbf6eaa1-6484-4830-9eb1-b0e99293f140 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:58.715604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fbf6eaa1-6484-4830-9eb1-b0e99293f140 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:58.851668 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fbf6eaa1-6484-4830-9eb1-b0e99293f140 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28095 microversion: 2.1 time: 0.154847 Jan 19 16:25:58.857067 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 115/233] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:58 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28095 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:25:59.080841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:59.141640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f0957425-d449-4c4b-9008-4325b4a5fe28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.946443 Jan 19 16:25:59.153711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 119/234] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:59.206109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:59.206109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:59.223793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.224628 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.225713 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.226813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.549595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:25:59.550853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:59.561204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.567769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.572576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.574039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.687986 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:25:59.698278 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3286aa66-1aad-4127-af8e-e6afddd1f492 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.497156 Jan 19 16:25:59.702003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 116/235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:59 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:25:59.719976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ef53283c-128d-4f9d-966e-c3fe89696df1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:59.723107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ef53283c-128d-4f9d-966e-c3fe89696df1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:59.736386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef53283c-128d-4f9d-966e-c3fe89696df1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.737206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef53283c-128d-4f9d-966e-c3fe89696df1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.741160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef53283c-128d-4f9d-966e-c3fe89696df1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.747295 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef53283c-128d-4f9d-966e-c3fe89696df1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.892501 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ef53283c-128d-4f9d-966e-c3fe89696df1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28549 microversion: 2.20 time: 0.188532 Jan 19 16:25:59.893537 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 117/236] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:25:59 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28549 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:25:59.902804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-76c57203-5477-4711-89af-2af27b68f39b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:25:59.904242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-76c57203-5477-4711-89af-2af27b68f39b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:25:59.912925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-76c57203-5477-4711-89af-2af27b68f39b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.913747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-76c57203-5477-4711-89af-2af27b68f39b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.914582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-76c57203-5477-4711-89af-2af27b68f39b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:25:59.915197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-76c57203-5477-4711-89af-2af27b68f39b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:25:59.965379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:00.002133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-274ccd13-3637-47d8-9ea5-98f90c1afe01 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.456224 Jan 19 16:26:00.005124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 120/237] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:25:59 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:00.086547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-76c57203-5477-4711-89af-2af27b68f39b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28157 microversion: 2.1 time: 0.190828 Jan 19 16:26:00.087636 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 118/238] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:25:59 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28157 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:00.167531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:00.168508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:00.183296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:00.189385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:00.190888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:00.197485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:00.518864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:00.527378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0b64a4bd-b865-49a4-a695-721e0b5e5233 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.367788 Jan 19 16:26:00.531663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 121/239] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:00.732518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:00.742691 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:00.762025 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:00.762983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:00.764190 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:00.764893 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:00.905971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eb83b534-a686-40df-bc17-dcd9b0109376 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:00.908411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eb83b534-a686-40df-bc17-dcd9b0109376 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:00.917399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb83b534-a686-40df-bc17-dcd9b0109376 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:00.918347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb83b534-a686-40df-bc17-dcd9b0109376 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:00.919411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb83b534-a686-40df-bc17-dcd9b0109376 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:00.920109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb83b534-a686-40df-bc17-dcd9b0109376 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:01.162900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:01.174775 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-af53cde6-29b1-48f2-a710-9534f2ad9941 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.451504 Jan 19 16:26:01.175776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 119/240] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:00 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:01.192872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:01.194124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:01.208679 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:01.209523 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:01.211624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:01.212527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:01.379260 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:01.388041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-09ebdca1-b4be-40e9-95f6-7c1c041f5ce9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.205538 Jan 19 16:26:01.388635 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 120/241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:01 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:01.394224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1fbe696e-99b2-49b0-96c9-4ec9c002af80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:01.395165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1fbe696e-99b2-49b0-96c9-4ec9c002af80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:01.401918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fbe696e-99b2-49b0-96c9-4ec9c002af80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:01.402374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fbe696e-99b2-49b0-96c9-4ec9c002af80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:01.403187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fbe696e-99b2-49b0-96c9-4ec9c002af80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:01.403631 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fbe696e-99b2-49b0-96c9-4ec9c002af80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:03.607871 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1fbe696e-99b2-49b0-96c9-4ec9c002af80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28157 microversion: 2.1 time: 2.217066 Jan 19 16:26:03.609457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 121/242] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:01 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28157 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:03.624291 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:03.627855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:03.641914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:03.643295 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:03.644741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eb83b534-a686-40df-bc17-dcd9b0109376 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28592 microversion: 2.20 time: 2.742742 Jan 19 16:26:03.645968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 122/243] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:00 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28592 bytes in 2745 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:03.655201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:03.656423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:03.656879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:03.657819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:03.672014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:03.676190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:03.677194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:03.677732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:04.041821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:04.067084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c603843c-bac9-4e59-b446-c558feed1b59 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.419393 Jan 19 16:26:04.072607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 123/244] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:03 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:04.075331 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:04.085713 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fc950e1d-7e95-4fab-aa6c-c31acbcaf39e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.469039 Jan 19 16:26:04.093010 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 122/245] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:04.101907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:04.101907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:04.105072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:04.106826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:04.108465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:04.109405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:04.336702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:04.346001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-373f4569-e2cd-4a85-82fd-abb2b0d70059 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.268650 Jan 19 16:26:04.347024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 124/246] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:04 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:04.625013 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c73bf8cb-476b-4a4c-8660-2c7cdac9ce83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:04.627075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c73bf8cb-476b-4a4c-8660-2c7cdac9ce83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:04.640673 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73bf8cb-476b-4a4c-8660-2c7cdac9ce83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:04.641426 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73bf8cb-476b-4a4c-8660-2c7cdac9ce83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:04.643043 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73bf8cb-476b-4a4c-8660-2c7cdac9ce83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:04.648356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73bf8cb-476b-4a4c-8660-2c7cdac9ce83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:04.668489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9464ee08-d902-4ca7-b57b-f8189bbbe88c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:04.671828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9464ee08-d902-4ca7-b57b-f8189bbbe88c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:04.705847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9464ee08-d902-4ca7-b57b-f8189bbbe88c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:04.706633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9464ee08-d902-4ca7-b57b-f8189bbbe88c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:04.708225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9464ee08-d902-4ca7-b57b-f8189bbbe88c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:04.708982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9464ee08-d902-4ca7-b57b-f8189bbbe88c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:04.751709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c73bf8cb-476b-4a4c-8660-2c7cdac9ce83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28157 microversion: 2.1 time: 0.132629 Jan 19 16:26:04.757547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 123/247] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:04 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28157 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:04.830330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9464ee08-d902-4ca7-b57b-f8189bbbe88c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28592 microversion: 2.20 time: 0.174884 Jan 19 16:26:04.831014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 125/248] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:04 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28592 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:05.111215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:05.112913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:05.126601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:05.128405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:05.148661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.149923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.151625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.152753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.156766 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.157713 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.167002 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.170156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.651293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:05.662289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d5c857b6-4049-4ec1-9523-6fa817410a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.550169 Jan 19 16:26:05.662986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 126/249] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:05.673130 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:05.680005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:05.689578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:05.700938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-78c32ff8-47ec-40d8-b3e5-060578d58c39 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.599989 Jan 19 16:26:05.703415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 124/250] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:05 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:05.711138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.711704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.712591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.713204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.766250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-da664ccd-08f3-45a2-b843-2818db6c8598 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:05.767217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-da664ccd-08f3-45a2-b843-2818db6c8598 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:05.777699 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da664ccd-08f3-45a2-b843-2818db6c8598 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.781317 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da664ccd-08f3-45a2-b843-2818db6c8598 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.782324 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da664ccd-08f3-45a2-b843-2818db6c8598 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:05.785065 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da664ccd-08f3-45a2-b843-2818db6c8598 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:05.955307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:05.971920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7e0c5a0-0e3a-4b05-a882-827c9bafb5dd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.306413 Jan 19 16:26:05.974463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 127/251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:05 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:05.993805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e9b8194b-25e6-4990-87f0-ccdc5149011b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:05.995319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e9b8194b-25e6-4990-87f0-ccdc5149011b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:06.012796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b8194b-25e6-4990-87f0-ccdc5149011b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:06.014130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b8194b-25e6-4990-87f0-ccdc5149011b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:06.015819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b8194b-25e6-4990-87f0-ccdc5149011b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:06.017283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b8194b-25e6-4990-87f0-ccdc5149011b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:06.125553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e9b8194b-25e6-4990-87f0-ccdc5149011b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28592 microversion: 2.20 time: 0.148191 Jan 19 16:26:06.129290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 128/252] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:05 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28592 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:06.147017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-da664ccd-08f3-45a2-b843-2818db6c8598 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28351 microversion: 2.1 time: 0.384183 Jan 19 16:26:06.154385 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 125/253] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:05 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28351 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:06.693502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:06.695402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:06.704828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:06.705607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:06.706775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:06.707436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:06.736973 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:06.738249 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:06.762037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:06.762484 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:06.777096 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:06.778918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:07.044030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:07.059774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c4923cec-6eb9-48ec-a88c-441276e8f2fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1521 microversion: 2.1 time: 0.365429 Jan 19 16:26:07.060972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 129/254] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:07.076736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:07.077994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:07.087822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:07.090999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:07.092376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:07.092940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:07.157883 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:07.186992 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f62cae1f-476d-4cb5-86c2-28545ee286f6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.457393 Jan 19 16:26:07.190400 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 126/255] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:06 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:07.204501 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6ac847f9-a14c-4f04-a902-c959525e6faf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:07.207230 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6ac847f9-a14c-4f04-a902-c959525e6faf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:07.221146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ac847f9-a14c-4f04-a902-c959525e6faf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:07.222195 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ac847f9-a14c-4f04-a902-c959525e6faf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:07.224487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ac847f9-a14c-4f04-a902-c959525e6faf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:07.226409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ac847f9-a14c-4f04-a902-c959525e6faf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:07.359052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6ac847f9-a14c-4f04-a902-c959525e6faf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28592 microversion: 2.20 time: 0.165187 Jan 19 16:26:07.360066 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 127/256] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:07 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28592 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:07.367003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7c84a8d1-1920-479a-b461-59a8d299ea0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:07.379693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7c84a8d1-1920-479a-b461-59a8d299ea0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:07.387804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c84a8d1-1920-479a-b461-59a8d299ea0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:07.388528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c84a8d1-1920-479a-b461-59a8d299ea0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:07.390118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c84a8d1-1920-479a-b461-59a8d299ea0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:07.390825 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c84a8d1-1920-479a-b461-59a8d299ea0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:07.401393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:07.412495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-881e9903-1f9d-4865-9c30-59faa5b65d7d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.348619 Jan 19 16:26:07.414359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 130/257] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:07 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:07.533729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7c84a8d1-1920-479a-b461-59a8d299ea0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28447 microversion: 2.1 time: 0.170459 Jan 19 16:26:07.538866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 128/258] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:07 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:08.084288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:08.089519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:08.111445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.112014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.113804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.115302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.224271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:08.226578 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:08.245686 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.248970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.250905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.251948 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.461840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:08.480270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-97792c12-e787-4e58-9081-8a44a7a6d8c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1501 microversion: 2.1 time: 0.402349 Jan 19 16:26:08.482483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 131/259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1501 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:08.509419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ba20c922-912c-4d72-921f-b253befaeb2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:08.510908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ba20c922-912c-4d72-921f-b253befaeb2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:08.520966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba20c922-912c-4d72-921f-b253befaeb2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.521702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba20c922-912c-4d72-921f-b253befaeb2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.523892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba20c922-912c-4d72-921f-b253befaeb2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.526043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba20c922-912c-4d72-921f-b253befaeb2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.598797 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:08.611232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-aa1fd509-88bc-4f7b-a900-3b55d7b051fe tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.404657 Jan 19 16:26:08.612133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 129/260] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:08 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:08.623652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:08.625440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:08.628799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ba20c922-912c-4d72-921f-b253befaeb2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 28592 microversion: 2.20 time: 0.143429 Jan 19 16:26:08.629964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 132/261] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:08 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 28592 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:08.641338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25eb1f3e-bf89-4611-96ec-acb18f21e993"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:08.642091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.642841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.644297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.645389 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.662094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:08.674907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.676763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.686748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.687877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.750052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] HTTP exception thrown: Cannot 'attach_volume' instance e119b741-b721-47fa-a03f-be8689acf2fd while it is in vm_state rescued Jan 19 16:26:08.751584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Returning 409 to user: Cannot 'attach_volume' instance e119b741-b721-47fa-a03f-be8689acf2fd while it is in vm_state rescued {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:26:08.758869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d90ae25f-595e-4514-8d78-2b503d597334 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.125444 Jan 19 16:26:08.760094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 133/262] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:26:08 2022] POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 19 16:26:08.768869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9f9b88eb-c7f9-42b0-91c0-a2c1608a5e1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:08.770914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9f9b88eb-c7f9-42b0-91c0-a2c1608a5e1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:08.783049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f9b88eb-c7f9-42b0-91c0-a2c1608a5e1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.785130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f9b88eb-c7f9-42b0-91c0-a2c1608a5e1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.786994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f9b88eb-c7f9-42b0-91c0-a2c1608a5e1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.788044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f9b88eb-c7f9-42b0-91c0-a2c1608a5e1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.911643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9f9b88eb-c7f9-42b0-91c0-a2c1608a5e1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28613 microversion: 2.1 time: 0.148717 Jan 19 16:26:08.912896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 134/263] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:08 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28613 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:08.931838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8ed0a7d7-e142-4a55-b8a0-1e1c90f842cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:08.941061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8ed0a7d7-e142-4a55-b8a0-1e1c90f842cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:08.971191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ed0a7d7-e142-4a55-b8a0-1e1c90f842cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.973217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ed0a7d7-e142-4a55-b8a0-1e1c90f842cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:08.977140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ed0a7d7-e142-4a55-b8a0-1e1c90f842cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:08.978630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ed0a7d7-e142-4a55-b8a0-1e1c90f842cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:09.052652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:09.065851 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d37f12bb-f1a5-47ae-9a6f-1eddcfbaeef6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.451652 Jan 19 16:26:09.086349 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 130/264] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:08 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:09.294588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8ed0a7d7-e142-4a55-b8a0-1e1c90f842cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action" status: 202 len: 0 microversion: 2.1 time: 0.376577 Jan 19 16:26:09.306281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 135/265] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:08 2022] POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:09.317677 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:09.319030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:09.329511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:09.331913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:09.334747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:09.337508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:09.668145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:09.669898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:09.714608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:09.717640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:09.728377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:09.730008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:10.190294 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:10.224126 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-69e1178e-d767-43b5-b61b-79c10eef1488 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1509 microversion: 2.1 time: 0.907594 Jan 19 16:26:10.229068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 131/266] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1509 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:10.247248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-36b5a489-eff5-4a87-881a-742fd0f860d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:10.256086 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-36b5a489-eff5-4a87-881a-742fd0f860d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:10.286552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36b5a489-eff5-4a87-881a-742fd0f860d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:10.289669 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36b5a489-eff5-4a87-881a-742fd0f860d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:10.297578 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36b5a489-eff5-4a87-881a-742fd0f860d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:10.301709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36b5a489-eff5-4a87-881a-742fd0f860d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:10.443942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:10.458185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76626337-518d-4114-9294-b3c37228d163 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.831732 Jan 19 16:26:10.458805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 136/267] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:09 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:10.476408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-823a2c66-1225-4063-8f62-9b2ee17baf74 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:10.477527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-823a2c66-1225-4063-8f62-9b2ee17baf74 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:10.492270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-823a2c66-1225-4063-8f62-9b2ee17baf74 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:10.492734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-823a2c66-1225-4063-8f62-9b2ee17baf74 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:10.493558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-823a2c66-1225-4063-8f62-9b2ee17baf74 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:10.494001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-823a2c66-1225-4063-8f62-9b2ee17baf74 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:10.525710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-36b5a489-eff5-4a87-881a-742fd0f860d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 29902 microversion: 2.20 time: 0.293842 Jan 19 16:26:10.527902 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 132/268] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:10 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 29902 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:10.559451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:10.561794 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:10.596144 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:10.596918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:10.601577 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:10.603835 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:10.682929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-823a2c66-1225-4063-8f62-9b2ee17baf74 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28613 microversion: 2.1 time: 0.222355 Jan 19 16:26:10.684694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 137/269] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:10 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28613 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:11.254193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:11.263178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:11.299572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:11.311103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-efd831a7-c7d9-4b86-a9ff-31fa55a85fe6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.781055 Jan 19 16:26:11.315728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 133/270] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:10 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:11.341450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:11.342244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:11.353959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:11.358499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:11.486776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:11.487409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:11.498081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:11.499167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:11.503088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:11.504623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:12.683549 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:12.692764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:12.702401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7dc7c30b-4489-4502-bd5a-b9c86f17bf2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1509 microversion: 2.1 time: 1.458078 Jan 19 16:26:12.724226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 138/271] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1509 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:12.726697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f79977bf-f80a-466f-a694-e2c6ee9e2d27 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 1.236622 Jan 19 16:26:12.733707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40f58e86-e330-4dcd-8cbf-aefa082a50a8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:12.738383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40f58e86-e330-4dcd-8cbf-aefa082a50a8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:12.752965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 134/272] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:11 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:12.755400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40f58e86-e330-4dcd-8cbf-aefa082a50a8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:12.756121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40f58e86-e330-4dcd-8cbf-aefa082a50a8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:12.759654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40f58e86-e330-4dcd-8cbf-aefa082a50a8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:12.760406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40f58e86-e330-4dcd-8cbf-aefa082a50a8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:12.769170 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5456ec6c-0e3f-423f-a645-394ebf15f751 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:12.776606 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5456ec6c-0e3f-423f-a645-394ebf15f751 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:12.799585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5456ec6c-0e3f-423f-a645-394ebf15f751 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:12.804867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5456ec6c-0e3f-423f-a645-394ebf15f751 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:12.806986 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5456ec6c-0e3f-423f-a645-394ebf15f751 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:12.811744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5456ec6c-0e3f-423f-a645-394ebf15f751 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:12.856798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40f58e86-e330-4dcd-8cbf-aefa082a50a8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 33396 microversion: 2.20 time: 0.130342 Jan 19 16:26:12.857735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 139/273] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:12 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 33396 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:12.887530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:12.888691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:12.900635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:12.901418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:12.902452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:12.903039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:12.920008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5456ec6c-0e3f-423f-a645-394ebf15f751 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28613 microversion: 2.1 time: 0.164458 Jan 19 16:26:12.923901 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 135/274] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:12 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28613 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:13.727869 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:13.728740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:13.751980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:13.767503 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:13.768229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:13.769156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:13.769614 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:13.770652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1edb07b3-8c50-423a-89d7-8ae170743778 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.885639 Jan 19 16:26:13.771324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 140/275] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:12 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:13.789715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:13.805096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:13.830437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:13.838595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:13.840557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:13.841770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.477757 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:14.503190 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ce8f1427-6ddc-40a5-85df-fb1294a924ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1509 microversion: 2.1 time: 0.779808 Jan 19 16:26:14.505842 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 136/276] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1509 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:14.535559 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-47557cab-8225-4fb0-bd35-1268228a147e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:14.541461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-47557cab-8225-4fb0-bd35-1268228a147e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:14.577633 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47557cab-8225-4fb0-bd35-1268228a147e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:14.578573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47557cab-8225-4fb0-bd35-1268228a147e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.581135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47557cab-8225-4fb0-bd35-1268228a147e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:14.582916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47557cab-8225-4fb0-bd35-1268228a147e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.708326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-47557cab-8225-4fb0-bd35-1268228a147e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 34636 microversion: 2.20 time: 0.200642 Jan 19 16:26:14.710240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 137/277] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:14 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 34636 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:14.721655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-a85f7d04-e759-4e46-a959-8654edd3ffa8 req-c214418a-208e-4985-9a43-de67544cf000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda15853-ef18-40f3-9063-9e714ebd9a12", "name": "network-vif-plugged", "status": "completed", "tag": "02b33aa9-3f6d-484d-b8ed-49177f61589f"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:14.724118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:26:14.724118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:26:14.742440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:14.752657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-a85f7d04-e759-4e46-a959-8654edd3ffa8 req-c214418a-208e-4985-9a43-de67544cf000 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:14.756452 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-a85f7d04-e759-4e46-a959-8654edd3ffa8 req-c214418a-208e-4985-9a43-de67544cf000 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.797123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-a85f7d04-e759-4e46-a959-8654edd3ffa8 req-c214418a-208e-4985-9a43-de67544cf000 service nova] Creating event network-vif-plugged:02b33aa9-3f6d-484d-b8ed-49177f61589f for instance eda15853-ef18-40f3-9063-9e714ebd9a12 on hv-cinder-78447 Jan 19 16:26:14.805927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-139812d8-edff-4f2a-b62f-131035e74a55 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 1.025375 Jan 19 16:26:14.806657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-a85f7d04-e759-4e46-a959-8654edd3ffa8 req-c214418a-208e-4985-9a43-de67544cf000 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091764 Jan 19 16:26:14.807879 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 138/278] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:14.808836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 141/279] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:13 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:14.835337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3e0dd190-81e4-436d-bbd1-71b3e864c68c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:14.837023 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3e0dd190-81e4-436d-bbd1-71b3e864c68c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:14.839217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:14.841633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:14.850301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e0dd190-81e4-436d-bbd1-71b3e864c68c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:14.850873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e0dd190-81e4-436d-bbd1-71b3e864c68c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.853712 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e0dd190-81e4-436d-bbd1-71b3e864c68c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:14.854581 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e0dd190-81e4-436d-bbd1-71b3e864c68c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.873018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:14.880368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.882703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:14.883307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:14.959511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3e0dd190-81e4-436d-bbd1-71b3e864c68c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 28613 microversion: 2.1 time: 0.137388 Jan 19 16:26:14.960705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 139/280] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:14 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 28613 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:15.347196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:15.356884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8ece52a1-e237-4c2a-9eb9-a85a8570c1e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.543515 Jan 19 16:26:15.358266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 142/281] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:14 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:15.532229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:15.533154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:15.550422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:15.552591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:15.555065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:15.556685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:15.791303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:15.799418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-80191614-b523-4d18-9e81-2245dedb397c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1515 microversion: 2.1 time: 0.272639 Jan 19 16:26:15.805082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 143/282] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:15.805175 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-11a1731f-d3d5-410a-82d5-8900f0b813c5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Action: 'create', calling method: .version_select at 0x7f716c300430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-521557695"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:15.830011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d1e8ccc4-8e3e-43d7-a2af-a0c0c4c18829 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:15.837946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d1e8ccc4-8e3e-43d7-a2af-a0c0c4c18829 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:15.850001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1e8ccc4-8e3e-43d7-a2af-a0c0c4c18829 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:15.855371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1e8ccc4-8e3e-43d7-a2af-a0c0c4c18829 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:15.856805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1e8ccc4-8e3e-43d7-a2af-a0c0c4c18829 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:15.869033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1e8ccc4-8e3e-43d7-a2af-a0c0c4c18829 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:15.872307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-11a1731f-d3d5-410a-82d5-8900f0b813c5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for project 27fc0bc850044ad690c3db4879b19c43. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:26:15.894913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-11a1731f-d3d5-410a-82d5-8900f0b813c5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for user b7616da9db584316b3a8ad4bb1ede6e8 and project 27fc0bc850044ad690c3db4879b19c43. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:26:16.003663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d1e8ccc4-8e3e-43d7-a2af-a0c0c4c18829 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 35458 microversion: 2.20 time: 0.200583 Jan 19 16:26:16.004604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 144/283] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:15 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 35458 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:16.011859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:16.016723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:16.029431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:16.029880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:16.030739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:16.031175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:16.186056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-11a1731f-d3d5-410a-82d5-8900f0b813c5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for project 27fc0bc850044ad690c3db4879b19c43. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:26:16.191366 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-11a1731f-d3d5-410a-82d5-8900f0b813c5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for user b7616da9db584316b3a8ad4bb1ede6e8 and project 27fc0bc850044ad690c3db4879b19c43. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:26:16.211546 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-11a1731f-d3d5-410a-82d5-8900f0b813c5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.800347 Jan 19 16:26:16.214302 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 140/284] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Jan 19 16:26:15 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:16.236110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2fc16af4-ad74-44cc-a2fb-8ee5c33ae389 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:16.237487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2fc16af4-ad74-44cc-a2fb-8ee5c33ae389 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:16.251690 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2fc16af4-ad74-44cc-a2fb-8ee5c33ae389 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:16.252193 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2fc16af4-ad74-44cc-a2fb-8ee5c33ae389 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:16.253409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2fc16af4-ad74-44cc-a2fb-8ee5c33ae389 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:16.253839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2fc16af4-ad74-44cc-a2fb-8ee5c33ae389 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:16.370952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2fc16af4-ad74-44cc-a2fb-8ee5c33ae389 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 29915 microversion: 2.1 time: 0.152743 Jan 19 16:26:16.374467 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 141/285] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:16 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 29915 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:16.386112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:16.389010 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:16.400381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:16.417114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-047c61b8-3f35-4f44-8a24-4012272aaff7 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.409055 Jan 19 16:26:16.419316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 145/286] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:16 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:16.436585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:16.437187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:16.439226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:16.440150 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:16.856176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-736c8ca1-a883-4d42-8e0d-e8c1213d3e1e req-97f20496-ca5d-43e4-bfa3-4715386606c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c468c7-0274-4ef8-97d8-8569a4e123b3", "name": "network-vif-plugged", "status": "completed", "tag": "16baa7f0-2118-4683-91f3-22df6226182a"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:16.860755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:26:16.860755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:26:16.882049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-736c8ca1-a883-4d42-8e0d-e8c1213d3e1e req-97f20496-ca5d-43e4-bfa3-4715386606c0 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:16.882993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-736c8ca1-a883-4d42-8e0d-e8c1213d3e1e req-97f20496-ca5d-43e4-bfa3-4715386606c0 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:16.907803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-736c8ca1-a883-4d42-8e0d-e8c1213d3e1e req-97f20496-ca5d-43e4-bfa3-4715386606c0 service nova] Creating event network-vif-plugged:16baa7f0-2118-4683-91f3-22df6226182a for instance f8c468c7-0274-4ef8-97d8-8569a4e123b3 on hv-cinder-78447 Jan 19 16:26:16.920891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-736c8ca1-a883-4d42-8e0d-e8c1213d3e1e req-97f20496-ca5d-43e4-bfa3-4715386606c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070994 Jan 19 16:26:16.923242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 146/287] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jan 19 16:26:16.947522 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:16.957587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-20dbfa85-fcf3-4d1e-bae2-caa9df3912d8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1318 microversion: 2.1 time: 0.580728 Jan 19 16:26:16.958809 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 142/288] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:16 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:17.037643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bab308e5-3e2e-4f92-ab1d-8dc389ba6d33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:17.039159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bab308e5-3e2e-4f92-ab1d-8dc389ba6d33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:17.049742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bab308e5-3e2e-4f92-ab1d-8dc389ba6d33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.050610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bab308e5-3e2e-4f92-ab1d-8dc389ba6d33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.052124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bab308e5-3e2e-4f92-ab1d-8dc389ba6d33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.052916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bab308e5-3e2e-4f92-ab1d-8dc389ba6d33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.156492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bab308e5-3e2e-4f92-ab1d-8dc389ba6d33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 35954 microversion: 2.20 time: 0.140005 Jan 19 16:26:17.158189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 147/289] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:17 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 35954 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:17.385925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-53b76f19-40ae-4d49-b102-ed7f20aa97df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:17.386856 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-53b76f19-40ae-4d49-b102-ed7f20aa97df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:17.418463 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53b76f19-40ae-4d49-b102-ed7f20aa97df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.418925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53b76f19-40ae-4d49-b102-ed7f20aa97df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.419786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53b76f19-40ae-4d49-b102-ed7f20aa97df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.420245 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53b76f19-40ae-4d49-b102-ed7f20aa97df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.450170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:17.451475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:17.464786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.467601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.470356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.470848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.591447 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-53b76f19-40ae-4d49-b102-ed7f20aa97df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 31186 microversion: 2.1 time: 0.208807 Jan 19 16:26:17.595439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 143/290] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:17 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 31186 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:17.723799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:17.742405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0736b1e0-eebd-4a40-acf7-6f9da7ad5f21 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.299963 Jan 19 16:26:17.742983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 148/291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:17 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:17.801520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:17.802358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:17.810313 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.810771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.811590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:17.812414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:17.987494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:17.989072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:18.009119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:18.014657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:18.017055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:18.020997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:18.085149 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:18.106837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d3bd4780-4bcb-4b8c-9fd1-4df2d76d3ef6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1515 microversion: 2.1 time: 0.310797 Jan 19 16:26:18.112573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 144/292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:18.146054 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4212a250-9641-4a76-9d1b-80e38ea6896f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4910f108-5f0d-4679-bc43-c6ab496fe166"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:18.152777 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4212a250-9641-4a76-9d1b-80e38ea6896f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:18.169158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4212a250-9641-4a76-9d1b-80e38ea6896f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:18.170431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4212a250-9641-4a76-9d1b-80e38ea6896f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:18.172360 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4212a250-9641-4a76-9d1b-80e38ea6896f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:18.173488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4212a250-9641-4a76-9d1b-80e38ea6896f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:18.396181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:18.406503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-99cf690f-8cd2-4f59-975a-82ab5572a479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1505 microversion: 2.1 time: 0.422736 Jan 19 16:26:18.434961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 149/293] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:17 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:18.442729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-64dcc85a-b89c-4191-a835-5883a742018e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:18.446929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-64dcc85a-b89c-4191-a835-5883a742018e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:18.461666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64dcc85a-b89c-4191-a835-5883a742018e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:18.462447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64dcc85a-b89c-4191-a835-5883a742018e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:18.463788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64dcc85a-b89c-4191-a835-5883a742018e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:18.464554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64dcc85a-b89c-4191-a835-5883a742018e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:20.537490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-64dcc85a-b89c-4191-a835-5883a742018e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 38053 microversion: 2.20 time: 2.100530 Jan 19 16:26:20.543277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 150/294] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:18 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 38053 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:20.551589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e9b5cd91-7ac6-41de-8c35-a4d95d6b8957 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:20.553558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e9b5cd91-7ac6-41de-8c35-a4d95d6b8957 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:20.565430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd91-7ac6-41de-8c35-a4d95d6b8957 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:20.567217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd91-7ac6-41de-8c35-a4d95d6b8957 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:20.568662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd91-7ac6-41de-8c35-a4d95d6b8957 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:20.569779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd91-7ac6-41de-8c35-a4d95d6b8957 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:20.691599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e9b5cd91-7ac6-41de-8c35-a4d95d6b8957 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 34106 microversion: 2.1 time: 0.149282 Jan 19 16:26:20.693412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 151/295] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:20 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 34106 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:20.709208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:20.711147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:20.723991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:20.724822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:20.726596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:20.727768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:20.778517 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4212a250-9641-4a76-9d1b-80e38ea6896f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.637171 Jan 19 16:26:20.798506 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 145/296] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:26:18 2022] POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 194 bytes in 2660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:26:21.004833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:21.015021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0616dbaa-32d8-42e7-afc1-c0255c6e82a8 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1317 microversion: 2.1 time: 0.313156 Jan 19 16:26:21.016060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 152/297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:20 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:21.557853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-67ba82c0-0658-46d5-b94d-32c7a3fc4937 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:21.576483 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-67ba82c0-0658-46d5-b94d-32c7a3fc4937 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:21.590861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67ba82c0-0658-46d5-b94d-32c7a3fc4937 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:21.601800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67ba82c0-0658-46d5-b94d-32c7a3fc4937 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:21.602868 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67ba82c0-0658-46d5-b94d-32c7a3fc4937 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:21.603574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67ba82c0-0658-46d5-b94d-32c7a3fc4937 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:21.712291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3a279d48-2237-4a74-a3e8-c22a2da1993d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:21.714904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3a279d48-2237-4a74-a3e8-c22a2da1993d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:21.726855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3a279d48-2237-4a74-a3e8-c22a2da1993d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:21.728470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3a279d48-2237-4a74-a3e8-c22a2da1993d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:21.734509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3a279d48-2237-4a74-a3e8-c22a2da1993d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:21.735857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3a279d48-2237-4a74-a3e8-c22a2da1993d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:21.775088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-67ba82c0-0658-46d5-b94d-32c7a3fc4937 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 38121 microversion: 2.20 time: 0.225005 Jan 19 16:26:21.776873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 146/298] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:21 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 38121 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:21.878042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3a279d48-2237-4a74-a3e8-c22a2da1993d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 36374 microversion: 2.1 time: 0.172604 Jan 19 16:26:21.880892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 153/299] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:21 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 36374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:22.043554 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:22.044089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:22.055388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:22.055988 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:22.057165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:22.064883 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:22.275199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:22.289330 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cf879f85-0383-4f8f-ab0c-70f3d010564c tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1507 microversion: 2.1 time: 0.254462 Jan 19 16:26:22.290352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 147/300] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:22 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:22.797209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6d87d88-9a5e-4172-967d-1910f5a45641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:22.799047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6d87d88-9a5e-4172-967d-1910f5a45641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:22.813070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d87d88-9a5e-4172-967d-1910f5a45641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:22.814009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d87d88-9a5e-4172-967d-1910f5a45641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:22.815612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d87d88-9a5e-4172-967d-1910f5a45641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:22.816962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d87d88-9a5e-4172-967d-1910f5a45641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:22.892437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-07550c85-56b5-4f1b-9bec-6eaf2f94d208 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:22.893424 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-07550c85-56b5-4f1b-9bec-6eaf2f94d208 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:22.900562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07550c85-56b5-4f1b-9bec-6eaf2f94d208 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:22.901135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07550c85-56b5-4f1b-9bec-6eaf2f94d208 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:22.902023 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07550c85-56b5-4f1b-9bec-6eaf2f94d208 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:22.902514 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07550c85-56b5-4f1b-9bec-6eaf2f94d208 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:25.366430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6d87d88-9a5e-4172-967d-1910f5a45641 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 38121 microversion: 2.20 time: 2.576015 Jan 19 16:26:25.367964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 154/301] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:22 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 38121 bytes in 2580 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:25.398171 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-07550c85-56b5-4f1b-9bec-6eaf2f94d208 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 38044 microversion: 2.1 time: 2.509241 Jan 19 16:26:25.399364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 148/302] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:22 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 38044 bytes in 2512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:25.953294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ecd59efd-5d5e-4182-b049-550653ed0383 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a1ec1ad-c823-45f9-a056-a67ff9511ab3"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:25.955303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ecd59efd-5d5e-4182-b049-550653ed0383 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:25.971940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecd59efd-5d5e-4182-b049-550653ed0383 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:25.972676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecd59efd-5d5e-4182-b049-550653ed0383 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:25.974313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecd59efd-5d5e-4182-b049-550653ed0383 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:25.975569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ecd59efd-5d5e-4182-b049-550653ed0383 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:26.399648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4587217c-1da5-4474-a612-2f3c15042bd9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:26.401003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4587217c-1da5-4474-a612-2f3c15042bd9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:26.409584 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4587217c-1da5-4474-a612-2f3c15042bd9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:26.410360 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4587217c-1da5-4474-a612-2f3c15042bd9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:26.411698 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4587217c-1da5-4474-a612-2f3c15042bd9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:26.412344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4587217c-1da5-4474-a612-2f3c15042bd9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:26.413586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ecd59efd-5d5e-4182-b049-550653ed0383 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468185 Jan 19 16:26:26.414493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 155/303] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:26:25 2022] POST /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:26.422339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eb506705-e29e-449e-964f-75929f9a2358 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:26.424054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eb506705-e29e-449e-964f-75929f9a2358 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:26.440538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb506705-e29e-449e-964f-75929f9a2358 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:26.441877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb506705-e29e-449e-964f-75929f9a2358 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:26.443036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb506705-e29e-449e-964f-75929f9a2358 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:26.444263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb506705-e29e-449e-964f-75929f9a2358 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:26.559758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eb506705-e29e-449e-964f-75929f9a2358 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 38098 microversion: 2.1 time: 0.143802 Jan 19 16:26:26.560405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 156/304] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:26 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 38098 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:26.580694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4587217c-1da5-4474-a612-2f3c15042bd9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 38126 microversion: 2.20 time: 0.197167 Jan 19 16:26:26.581374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 149/305] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:26 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 38126 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:27.589506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40edb51c-c0ba-459c-9da2-4692377ffb8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:27.591985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40edb51c-c0ba-459c-9da2-4692377ffb8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:27.597766 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ebc5ceff-b8a8-4c2b-b93f-82768af9501f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:27.598612 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ebc5ceff-b8a8-4c2b-b93f-82768af9501f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:27.605812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40edb51c-c0ba-459c-9da2-4692377ffb8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:27.606412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40edb51c-c0ba-459c-9da2-4692377ffb8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:27.607925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40edb51c-c0ba-459c-9da2-4692377ffb8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:27.608617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40edb51c-c0ba-459c-9da2-4692377ffb8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:27.609506 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebc5ceff-b8a8-4c2b-b93f-82768af9501f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:27.610289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebc5ceff-b8a8-4c2b-b93f-82768af9501f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:27.612271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebc5ceff-b8a8-4c2b-b93f-82768af9501f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:27.613084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebc5ceff-b8a8-4c2b-b93f-82768af9501f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:29.956064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ebc5ceff-b8a8-4c2b-b93f-82768af9501f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 200 len: 38264 microversion: 2.20 time: 2.364758 Jan 19 16:26:29.956964 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 150/306] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:27 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 38264 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:26:29.983899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40edb51c-c0ba-459c-9da2-4692377ffb8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 38098 microversion: 2.1 time: 2.404290 Jan 19 16:26:29.985459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 157/307] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:27 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 38098 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:30.009840 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4e81a4f3-5d2e-40e3-b490-f16064a52f02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:30.010822 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4e81a4f3-5d2e-40e3-b490-f16064a52f02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:30.022020 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e81a4f3-5d2e-40e3-b490-f16064a52f02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:30.022694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e81a4f3-5d2e-40e3-b490-f16064a52f02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:30.024078 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e81a4f3-5d2e-40e3-b490-f16064a52f02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:30.024836 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e81a4f3-5d2e-40e3-b490-f16064a52f02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:30.068159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4e81a4f3-5d2e-40e3-b490-f16064a52f02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/ips" status: 200 len: 153 microversion: 2.20 time: 0.098865 Jan 19 16:26:30.069349 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 151/308] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Jan 19 16:26:29 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/ips => generated 153 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:31.005498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-de12850c-1dd7-441f-8d4d-7e0b7b83c020 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:31.008362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-de12850c-1dd7-441f-8d4d-7e0b7b83c020 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:31.023081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de12850c-1dd7-441f-8d4d-7e0b7b83c020 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:31.023901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de12850c-1dd7-441f-8d4d-7e0b7b83c020 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:31.025789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de12850c-1dd7-441f-8d4d-7e0b7b83c020 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:31.027611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de12850c-1dd7-441f-8d4d-7e0b7b83c020 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:31.169560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-de12850c-1dd7-441f-8d4d-7e0b7b83c020 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 38098 microversion: 2.1 time: 0.170797 Jan 19 16:26:31.171874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 158/309] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:30 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 38098 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:26:31.463724 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1568344791", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "df5b9818-486b-449f-affc-04a3bbff76f3"}]}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:31.801193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:31.802387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:31.816591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:31.817217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:31.818343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:31.819510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:31.854375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lazy-loading 'flavor' on Instance uuid e119b741-b721-47fa-a03f-be8689acf2fd {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:26:32.014897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-609f017d-9ebd-4816-8b25-03c47e45d757 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action" status: 200 len: 32 microversion: 2.1 time: 0.220344 Jan 19 16:26:32.015915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 159/310] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:31 2022] POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:26:32.026325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:32.027065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:32.038539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.039353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.040840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.041638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.313329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:32.326784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-98ec295f-fd9a-483b-b399-a6649b874df3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.304679 Jan 19 16:26:32.327941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 160/311] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:32.338115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7121fdc0-3f74-40a4-b39d-d325ad67ba9a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:32.339969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7121fdc0-3f74-40a4-b39d-d325ad67ba9a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:32.348836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7121fdc0-3f74-40a4-b39d-d325ad67ba9a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.349361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7121fdc0-3f74-40a4-b39d-d325ad67ba9a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.350270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7121fdc0-3f74-40a4-b39d-d325ad67ba9a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.350716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7121fdc0-3f74-40a4-b39d-d325ad67ba9a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.469807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7121fdc0-3f74-40a4-b39d-d325ad67ba9a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 38226 microversion: 2.1 time: 0.138698 Jan 19 16:26:32.471205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 161/312] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:32 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 38226 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:26:32.483226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-91aa44a5-06ee-454e-8713-b78b96f68db3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:32.483861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-91aa44a5-06ee-454e-8713-b78b96f68db3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:32.492425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91aa44a5-06ee-454e-8713-b78b96f68db3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.492869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91aa44a5-06ee-454e-8713-b78b96f68db3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.493659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91aa44a5-06ee-454e-8713-b78b96f68db3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.494089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91aa44a5-06ee-454e-8713-b78b96f68db3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.521535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-91aa44a5-06ee-454e-8713-b78b96f68db3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/ips" status: 200 len: 146 microversion: 2.1 time: 0.043052 Jan 19 16:26:32.522141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 162/313] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jan 19 16:26:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:26:32.891545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:32.892126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:32.899314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.900022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.900890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:32.901356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:32.942460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lazy-loading 'flavor' on Instance uuid 2b42b29d-6ec2-4fd8-b110-48af10080a11 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:26:46.887350 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.network.neutron [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] validate_networks() for [('df5b9818-486b-449f-affc-04a3bbff76f3', None, None, None, None, None)] {{(pid=116209) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:26:47.294593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-24541ff1-7211-412c-a60b-64940708f484 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 202 len: 0 microversion: 2.20 time: 14.406115 Jan 19 16:26:47.299555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 163/314] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:26:32 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 0 bytes in 14412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:26:47.313180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:47.315143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:47.330416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:47.332632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:47.336689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:47.337906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:47.948880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:47.972709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-826a062e-584d-460d-bc4d-f570aa8ff306 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.668388 Jan 19 16:26:47.980651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 164/315] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:47.997433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cdec712f-9918-44c2-ba08-9836c63a4072 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d842211-63a9-4d6f-88fa-689e9984aa57"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:48.010983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cdec712f-9918-44c2-ba08-9836c63a4072 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:48.029889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cdec712f-9918-44c2-ba08-9836c63a4072 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.032516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cdec712f-9918-44c2-ba08-9836c63a4072 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.033559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cdec712f-9918-44c2-ba08-9836c63a4072 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.034840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cdec712f-9918-44c2-ba08-9836c63a4072 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.448455 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Flavor limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:26:48.449422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Image limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:26:48.450345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Flavor pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:26:48.452511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Image pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:26:48.452933 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:26:48.465539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cdec712f-9918-44c2-ba08-9836c63a4072 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480132 Jan 19 16:26:48.469532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 165/316] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:26:47 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:48.479047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.480118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a1ec1ad-c823-45f9-a056-a67ff9511ab3"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:48.480629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.481406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:48.482433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.483342 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.496622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.497386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.508090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.508734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.535080 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Getting quotas for project 15f0fb14f0904844a6eb3b141098a26e. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:26:48.551632 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Getting quotas for user 131440980fb64308b818f7dd667ec70c and project 15f0fb14f0904844a6eb3b141098a26e. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:26:48.593491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Going to run 1 instances... {{(pid=116209) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:26:48.601027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:26:48.822231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5eafbda1-e707-4c12-af6a-5bdc38a9c710 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.360894 Jan 19 16:26:48.823332 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 152/317] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:26:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 17369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:26:48.840078 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:48.845679 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:48.859124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] HTTP exception thrown: Invalid volume: volume 7a1ec1ad-c823-45f9-a056-a67ff9511ab3 is already attached to instances: f8c468c7-0274-4ef8-97d8-8569a4e123b3 Jan 19 16:26:48.861446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Returning 400 to user: Invalid volume: volume 7a1ec1ad-c823-45f9-a056-a67ff9511ab3 is already attached to instances: f8c468c7-0274-4ef8-97d8-8569a4e123b3 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:26:48.866166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8525222c-31bc-444b-a80b-7d80d38dc710 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.393675 Jan 19 16:26:48.868418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 166/318] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:26:48 2022] POST /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 174 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:26:48.884148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.884578 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.885515 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:48.885971 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:48.888153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5f4fde14-fd4c-4c18-a698-767d903ede35 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:48.889090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5f4fde14-fd4c-4c18-a698-767d903ede35 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:49.077807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5f4fde14-fd4c-4c18-a698-767d903ede35 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:49.086167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5f4fde14-fd4c-4c18-a698-767d903ede35 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1214 microversion: 2.1 time: 0.211122 Jan 19 16:26:49.090152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 167/319] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:48 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:49.104984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:49.120669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:49.128550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:49.131073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:49.132328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:49.134824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:49.451003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:49.460648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:49.470587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:49.472297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9f79cce1-d235-48cf-be5e-0801d83e918e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.647573 Jan 19 16:26:49.473125 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 153/320] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:26:48 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:26:49.487645 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:49.488220 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:49.502917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:49.502917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:49.504595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:49.504595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:49.580986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:49.621364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f7df7f20-2c93-4ce3-a7c9-6348cefde9a6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.516555 Jan 19 16:26:49.653190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 168/321] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:49.727108 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.objects.instance [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lazy-loading 'services' on Instance uuid f8c468c7-0274-4ef8-97d8-8569a4e123b3 {{(pid=116209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:26:50.043830 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-130991df-42d6-4952-8935-0ea4408c5c0b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments/7a1ec1ad-c823-45f9-a056-a67ff9511ab3" status: 202 len: 0 microversion: 2.1 time: 0.568639 Jan 19 16:26:50.072136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a263beb5-2c33-4a65-84e1-90cea1ac7bc6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:50.074566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a263beb5-2c33-4a65-84e1-90cea1ac7bc6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:50.077827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 154/322] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:26:49 2022] DELETE /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments/7a1ec1ad-c823-45f9-a056-a67ff9511ab3 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:50.108057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:50.109051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:50.113860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a263beb5-2c33-4a65-84e1-90cea1ac7bc6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.115624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a263beb5-2c33-4a65-84e1-90cea1ac7bc6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.117055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a263beb5-2c33-4a65-84e1-90cea1ac7bc6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.125675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a263beb5-2c33-4a65-84e1-90cea1ac7bc6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.141440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.146558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.147619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.155554 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.280058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a263beb5-2c33-4a65-84e1-90cea1ac7bc6 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217787 Jan 19 16:26:50.284735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 169/323] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:26:50 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:50.384241 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:50.406894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-38c00e54-232e-4ed4-a697-015762893f7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1210 microversion: 2.1 time: 0.303978 Jan 19 16:26:50.412766 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 155/324] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:50 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1210 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:50.494350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:50.495211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:50.513206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.515358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.517333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.519513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.672976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:50.683862 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:50.703507 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.706196 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.722076 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:50.734852 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:50.988854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:51.004845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:51.008736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:51.012105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4cb8872c-37b6-4ee5-8423-98fc8a3e868f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.522138 Jan 19 16:26:51.014795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 170/325] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:26:50 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:26:51.295090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c38c2a4b-1b83-47bc-a4c0-87f545562418 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:51.296634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c38c2a4b-1b83-47bc-a4c0-87f545562418 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:51.323251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c38c2a4b-1b83-47bc-a4c0-87f545562418 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:51.331939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c38c2a4b-1b83-47bc-a4c0-87f545562418 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:51.333161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c38c2a4b-1b83-47bc-a4c0-87f545562418 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:51.333278 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:51.334036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c38c2a4b-1b83-47bc-a4c0-87f545562418 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:51.344956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-20cf2943-cc67-45cc-a918-69a393c90af5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.681551 Jan 19 16:26:51.345563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 156/326] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:51.403097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c38c2a4b-1b83-47bc-a4c0-87f545562418 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113041 Jan 19 16:26:51.403593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 171/327] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:26:51 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:26:51.433778 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:51.434736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:51.443889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:51.444598 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:51.445659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:51.446314 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:51.604858 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:51.630741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ad0c36e1-46f8-4bfa-8fde-129b43651b6a tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1272 microversion: 2.1 time: 0.202275 Jan 19 16:26:51.634337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 157/328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:51 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:52.053841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:52.056344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:52.082312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.084559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:52.086452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.087297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:52.395933 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:52.397172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:52.460960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.462236 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:52.468487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.470111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:52.566295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:52.582231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:52.584504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:52.589783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7dc95ed9-bc72-4d18-8fd3-8f3521166f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.543627 Jan 19 16:26:52.590419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 172/329] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:26:52 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:26:52.607708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4aeb61d-4b33-49f0-9368-baa9cd4c94a1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:52.610929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4aeb61d-4b33-49f0-9368-baa9cd4c94a1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:52.631299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4aeb61d-4b33-49f0-9368-baa9cd4c94a1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.631949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4aeb61d-4b33-49f0-9368-baa9cd4c94a1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:52.632995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4aeb61d-4b33-49f0-9368-baa9cd4c94a1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.633477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4aeb61d-4b33-49f0-9368-baa9cd4c94a1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:52.710199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4aeb61d-4b33-49f0-9368-baa9cd4c94a1 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118388 Jan 19 16:26:52.710887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 173/330] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:26:52 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:52.720638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:52.735041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:52.748590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.750598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:52.751508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:52.752001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:53.012058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:53.021439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-85794a22-4ee7-4650-b3bc-dd99f62a3567 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.653851 Jan 19 16:26:53.027171 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 158/331] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:53.142972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:53.161463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d938ca65-12fe-4546-8918-380905046448 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1314 microversion: 2.1 time: 0.443774 Jan 19 16:26:53.177955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 174/332] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:52 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:53.511614 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5d9aeee4-219c-4275-957e-4abd819a8c26 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Action: 'create', calling method: .version_select at 0x7f716c1d88b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-377539102"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:53.547186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-5d9aeee4-219c-4275-957e-4abd819a8c26 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Getting quotas for project 96815626740443b49edfbfc63d102d50. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:26:53.557480 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-5d9aeee4-219c-4275-957e-4abd819a8c26 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Getting quotas for user ce2e4573f7214551ac4ad108cce8c429 and project 96815626740443b49edfbfc63d102d50. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:26:53.628232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:53.630640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:53.641545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:53.642228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:53.654309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:53.655377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:53.987635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:54.002197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:54.004567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:54.006817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c4728501-3b33-44a1-b182-092c0b6493c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.384391 Jan 19 16:26:54.022052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 175/333] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:26:53 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:26:54.022313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e83b9d63-ab0a-4a6e-afcd-2867f8e26b78 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:54.033585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e83b9d63-ab0a-4a6e-afcd-2867f8e26b78 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:54.044581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e83b9d63-ab0a-4a6e-afcd-2867f8e26b78 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:54.045546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e83b9d63-ab0a-4a6e-afcd-2867f8e26b78 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:54.047184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e83b9d63-ab0a-4a6e-afcd-2867f8e26b78 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:54.048090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e83b9d63-ab0a-4a6e-afcd-2867f8e26b78 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:54.118744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e83b9d63-ab0a-4a6e-afcd-2867f8e26b78 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106232 Jan 19 16:26:54.120505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 176/334] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:26:54 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:54.151876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:54.156063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:54.176105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:54.176885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:54.182977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:54.182977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:54.306539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-5d9aeee4-219c-4275-957e-4abd819a8c26 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Getting quotas for project 96815626740443b49edfbfc63d102d50. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:26:54.313658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-5d9aeee4-219c-4275-957e-4abd819a8c26 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Getting quotas for user ce2e4573f7214551ac4ad108cce8c429 and project 96815626740443b49edfbfc63d102d50. Resources: {'key_pairs'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:26:54.339920 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5d9aeee4-219c-4275-957e-4abd819a8c26 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.133786 Jan 19 16:26:54.340994 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 159/335] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Jan 19 16:26:53 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:26:54.348101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-1a0f87f2-a910-41c4-997a-d37cf357da36 req-936b0371-8eea-4069-9a1b-10029e9e3d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6663883a-5a77-452f-9783-f135c679d6e4", "tag": "cfaaf6c6-4c1e-481a-a293-d4fd84e23f59"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:54.350807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:26:54.350807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:26:54.359648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-1a0f87f2-a910-41c4-997a-d37cf357da36 req-936b0371-8eea-4069-9a1b-10029e9e3d16 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:54.360393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-1a0f87f2-a910-41c4-997a-d37cf357da36 req-936b0371-8eea-4069-9a1b-10029e9e3d16 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:54.374277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-1a0f87f2-a910-41c4-997a-d37cf357da36 req-936b0371-8eea-4069-9a1b-10029e9e3d16 service nova] Creating event network-changed:cfaaf6c6-4c1e-481a-a293-d4fd84e23f59 for instance 6663883a-5a77-452f-9783-f135c679d6e4 on hv-cinder-78447 Jan 19 16:26:54.381348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-1a0f87f2-a910-41c4-997a-d37cf357da36 req-936b0371-8eea-4069-9a1b-10029e9e3d16 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038743 Jan 19 16:26:54.382059 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 160/336] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:54.397968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:54.399292 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:54.414602 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:54.415618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:54.417545 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:54.418386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:54.813350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:54.833957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-27a08066-0158-4a89-8bcf-a439c534ead1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.711637 Jan 19 16:26:54.835192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 177/337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:54.919304 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:54.940889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6ca59f87-f890-4a61-af51-9af6388e10a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1314 microversion: 2.1 time: 0.556598 Jan 19 16:26:54.952298 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 161/338] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:54 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:55.039819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:55.041294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:55.055090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:55.055968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:55.056953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:55.057657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:55.135980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f0aa04a1-b4fb-4502-86d1-9566e8b6e92b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:55.138031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f0aa04a1-b4fb-4502-86d1-9566e8b6e92b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:55.169064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0aa04a1-b4fb-4502-86d1-9566e8b6e92b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:55.170041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0aa04a1-b4fb-4502-86d1-9566e8b6e92b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:55.173071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0aa04a1-b4fb-4502-86d1-9566e8b6e92b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:55.174348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0aa04a1-b4fb-4502-86d1-9566e8b6e92b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:55.236626 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f0aa04a1-b4fb-4502-86d1-9566e8b6e92b tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105735 Jan 19 16:26:55.238056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 162/339] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:26:55 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:26:55.341448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:55.364032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:55.369530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:55.372606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b99b8927-6538-4440-b6f9-f4d38d4113de tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.341482 Jan 19 16:26:55.374062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 178/340] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:26:55 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:26:55.882695 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:55.884539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:55.917184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:55.918005 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:55.919527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:55.920379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:55.971165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:55.972443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:55.995404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:56.001123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:56.009592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:56.010390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:56.494659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:56.508906 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2f0d005c-7d41-48f5-ae06-9cad6c9cef5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.653192 Jan 19 16:26:56.512609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 163/341] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:56.542751 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f07ce7de-1c05-4799-8156-a1ec0bd9ae22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:56.543956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f07ce7de-1c05-4799-8156-a1ec0bd9ae22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:56.551547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f07ce7de-1c05-4799-8156-a1ec0bd9ae22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:56.555954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f07ce7de-1c05-4799-8156-a1ec0bd9ae22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:56.557984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f07ce7de-1c05-4799-8156-a1ec0bd9ae22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:56.559648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f07ce7de-1c05-4799-8156-a1ec0bd9ae22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:56.575211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:56.586992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9f22d171-26f2-45ad-9038-1125fcd6a4a9 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1314 microversion: 2.1 time: 0.623727 Jan 19 16:26:56.588299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 179/342] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:55 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:56.596426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:56.598940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:56.613929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:56.615177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:56.616583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:56.617667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:56.661324 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f07ce7de-1c05-4799-8156-a1ec0bd9ae22 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146449 Jan 19 16:26:56.663582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 164/343] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:26:56 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:56.904733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d0356dc0-c476-4d78-8b40-be98c80e111a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:56.914655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d0356dc0-c476-4d78-8b40-be98c80e111a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:56.915401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d0356dc0-c476-4d78-8b40-be98c80e111a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:57.011949 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d0356dc0-c476-4d78-8b40-be98c80e111a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Going to try to stop instance {{(pid=116209) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 19 16:26:57.080409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:57.091636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:57.094279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:57.095828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5dbb605e-ef19-4a14-8eca-854581d97801 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.506170 Jan 19 16:26:57.097656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 180/344] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:26:56 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:26:57.124657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d0356dc0-c476-4d78-8b40-be98c80e111a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 202 len: 0 microversion: 2.1 time: 0.224578 Jan 19 16:26:57.133800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 165/345] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:26:56 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:26:57.140274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:57.141700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:57.164404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:57.166277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:57.168119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:57.169268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:57.548804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:57.548804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:57.566358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:57.566968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:57.573091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:57.577057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:57.582159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:57.605843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-80d9a061-646d-4156-a415-771ea0b371f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.472534 Jan 19 16:26:57.608287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 181/346] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:57.648691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:57.653197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:57.684631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:57.689997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:57.691468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:57.700787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:57.984526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:58.004322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-53d2eb31-2258-40e3-8ecb-6af1541b2059 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.473093 Jan 19 16:26:58.005886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 166/347] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:58.034954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1028002216", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-521557695", "security_groups": [{"name": "tempest-secgroup-smoke-792627283"}], "block_device_mapping_v2": [{"uuid": "842d5068-cc18-4b98-a5f8-6befddddd3e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "27a13afb-52ca-4667-a67d-ac2a2cf3df83"}]}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:58.174135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:58.193834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9dfa98fc-89ae-45b7-a0ba-1496789f619e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1314 microversion: 2.1 time: 0.583038 Jan 19 16:26:58.195171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 182/348] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:57 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:58.205456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bc400cf6-937b-458f-b3b2-5bf542fc4dc2 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:58.209181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bc400cf6-937b-458f-b3b2-5bf542fc4dc2 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:58.223949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc400cf6-937b-458f-b3b2-5bf542fc4dc2 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:58.231247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc400cf6-937b-458f-b3b2-5bf542fc4dc2 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:58.237344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc400cf6-937b-458f-b3b2-5bf542fc4dc2 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:58.254912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc400cf6-937b-458f-b3b2-5bf542fc4dc2 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:58.381976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bc400cf6-937b-458f-b3b2-5bf542fc4dc2 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.184197 Jan 19 16:26:58.393825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 183/349] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:26:58 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3/os-volume_attachments => generated 25 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:26:58.409967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-838f80bb-e174-4459-b5a6-9e296fe1beb9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48376b10-b1db-4320-8eb2-49131bc000e4", "device": "/dev/sdb"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:58.413592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-838f80bb-e174-4459-b5a6-9e296fe1beb9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:58.428571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838f80bb-e174-4459-b5a6-9e296fe1beb9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:58.429838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838f80bb-e174-4459-b5a6-9e296fe1beb9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:58.445487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838f80bb-e174-4459-b5a6-9e296fe1beb9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:58.447434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838f80bb-e174-4459-b5a6-9e296fe1beb9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:58.454461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.network.neutron [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] validate_networks() for [('27a13afb-52ca-4667-a67d-ac2a2cf3df83', None, None, None, None, None)] {{(pid=116209) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:26:59.118536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-838f80bb-e174-4459-b5a6-9e296fe1beb9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "POST /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722472 Jan 19 16:26:59.120440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 184/350] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:26:58 2022] POST /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:26:59.127625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:59.128884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:59.137773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.138867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.139942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.140508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.374989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Flavor limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:26:59.376111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Image limits 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:26:59.376997 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Flavor pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:26:59.377745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Image pref 0:0:0 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:26:59.378488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.virt.hardware [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:26:59.420090 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.421811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.423147 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.423967 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.453020 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for project 27fc0bc850044ad690c3db4879b19c43. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:26:59.463044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.quota [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for user b7616da9db584316b3a8ad4bb1ede6e8 and project 27fc0bc850044ad690c3db4879b19c43. Resources: {'ram', 'instances', 'cores'} {{(pid=116209) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:26:59.477304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:59.489548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:59.492440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:59.494839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4a4a354c-7904-448d-92b6-c7c2d5687168 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.372203 Jan 19 16:26:59.496428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 185/351] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:26:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:26:59.503515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:59.505788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:59.518273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.519184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.521514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.522493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.559416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Going to run 1 instances... {{(pid=116209) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:26:59.562883 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='842d5068-cc18-4b98-a5f8-6befddddd3e6',volume_size=None,volume_type=None)] {{(pid=116209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:26:59.740955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:26:59.762231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-890da9c2-9af8-44dc-af30-ce460d9b3104 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.264231 Jan 19 16:26:59.774638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 186/352] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:26:59.781920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1188211983", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "d8b0d303-631a-44be-8091-f10b96ec14c3"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:26:59.827574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7f6f7121-2c14-4c59-b637-f35a5d4d05f1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.805130 Jan 19 16:26:59.838798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 167/353] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:26:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:26:59.848860 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:26:59.850316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:26:59.865012 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.866270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.868522 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:26:59.869933 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:26:59.937876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] validate_networks() for [('d8b0d303-631a-44be-8091-f10b96ec14c3', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:27:00.448891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:00.469812 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a0e8c565-f2b1-4955-aaa0-c25eec1d68c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.628388 Jan 19 16:27:00.480602 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 168/354] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:26:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:00.484861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:00.485808 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:00.496323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:00.496832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:00.498076 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:00.498806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.002206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:01.024836 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-03c82cd7-05c4-433b-80d0-df0b615ea0ca tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1314 microversion: 2.1 time: 0.548535 Jan 19 16:27:01.026440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 169/355] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:00 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:01.042536 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:01.045072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:01.069258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.070684 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.072887 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.073749 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.081395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:27:01.083191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:27:01.083924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:27:01.084479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:27:01.085218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:27:01.106960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.107463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.109376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.110602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.139217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:27:01.148049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Getting quotas for user 9b66fbdfc39840b2962c8d7686098903 and project 3597b29cd8f14493bb90b292c67caf64. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:27:01.173445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:27:01.176431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:01.178022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:27:01.191065 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b304e127-a590-471f-aaa9-a85ff44388c8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1192 microversion: 2.1 time: 0.161671 Jan 19 16:27:01.216177 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 170/356] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:01 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1192 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:01.227157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:01.230341 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:01.245449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.246341 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.248263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.248990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.295156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-df333c75-93e6-4d02-8ad9-be56c2f56973 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530376 Jan 19 16:27:01.298018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 187/357] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:26:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:27:01.309513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:01.311784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:01.325208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.326298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.327856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:01.329303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:01.824709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:01.843048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-02cd3be2-99c6-4d96-a66a-f30b2121ce81 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.542195 Jan 19 16:27:01.858533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 188/358] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:01 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:01.881825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76afe50f-e0c1-40de-8175-734fc91f3cfb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:01.882500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76afe50f-e0c1-40de-8175-734fc91f3cfb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:02.062513 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:02.079424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-76afe50f-e0c1-40de-8175-734fc91f3cfb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:02.080117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:02.088445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76afe50f-e0c1-40de-8175-734fc91f3cfb tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1218 microversion: 2.1 time: 0.227567 Jan 19 16:27:02.089436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 189/359] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:01 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1218 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:02.098577 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:02.105207 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-64042b49-47cb-4406-864e-b4acf65f583a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.886604 Jan 19 16:27:02.107534 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 171/360] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:02.111269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:02.113037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:02.130396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.131136 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-7598ba2f-fe85-47dd-915a-865654550278 req-5bb08913-ac83-4adf-8ef4-fd427af7b96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6663883a-5a77-452f-9783-f135c679d6e4", "name": "network-vif-plugged", "status": "completed", "tag": "cfaaf6c6-4c1e-481a-a293-d4fd84e23f59"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:02.131730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.132942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.135529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.148201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:02.148201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:27:02.167755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-7598ba2f-fe85-47dd-915a-865654550278 req-5bb08913-ac83-4adf-8ef4-fd427af7b96e service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.168585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-7598ba2f-fe85-47dd-915a-865654550278 req-5bb08913-ac83-4adf-8ef4-fd427af7b96e service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.198160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-7598ba2f-fe85-47dd-915a-865654550278 req-5bb08913-ac83-4adf-8ef4-fd427af7b96e service nova] Creating event network-vif-plugged:cfaaf6c6-4c1e-481a-a293-d4fd84e23f59 for instance 6663883a-5a77-452f-9783-f135c679d6e4 on hv-cinder-78447 Jan 19 16:27:02.209151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-7598ba2f-fe85-47dd-915a-865654550278 req-5bb08913-ac83-4adf-8ef4-fd427af7b96e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098507 Jan 19 16:27:02.210922 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 172/361] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:02.228502 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:02.230079 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:02.245172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.245938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.247342 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.248420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.586037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:02.603999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-84a270d4-9bd6-4b96-bc02-6c42a90d0bf5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.502634 Jan 19 16:27:02.617067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 190/362] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:02.634029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:02.635841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:02.650364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.651986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.653730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.654704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.673979 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:02.701288 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3c8b2d80-df88-4772-b470-ef0d54b03df1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1314 microversion: 2.1 time: 0.487888 Jan 19 16:27:02.709820 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 173/363] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:02 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:02.788133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:02.799434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2e2441db-9aeb-4a63-a59b-e508b9112aaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1210 microversion: 2.1 time: 0.179951 Jan 19 16:27:02.800770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 191/364] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:02 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1210 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:02.889514 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:02.890326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:02.898877 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.899503 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:02.900583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:02.901226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:03.138164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:03.138952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:03.153159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:03.154072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:03.155625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:03.156472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:03.211713 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:03.226649 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f30adfc2-cdd0-4323-8889-b015ad2ed043 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.342516 Jan 19 16:27:03.241444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 174/365] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:03.241444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:03.241444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:03.249912 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:03.250721 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:03.252226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:03.253043 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:03.269690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:03.283661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ac3c410a-2559-4ecd-bcc1-3582708ffd61 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1270 microversion: 2.1 time: 0.147057 Jan 19 16:27:03.284983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 192/366] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:03 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:03.642284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:03.643875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:03.662049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:03.664734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:03.671402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:03.695667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:04.245303 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:04.262690 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:04.265719 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:04.268110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7e2b571f-267e-455a-9c86-20ba2cd405d1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 1.038560 Jan 19 16:27:04.270007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 175/367] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:03 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:04.294878 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:04.296582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:04.313458 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:04.314894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:04.317329 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:04.318618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:04.579390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:04.608153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8d804b93-8ad5-42f2-b762-6a8487b89f6e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.973741 Jan 19 16:27:04.614717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 193/368] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:04.630754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:04.643147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:04.657948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:04.660671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:04.664934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:04.665615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:04.737532 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:04.758473 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f46b4430-3372-47e8-9f4e-b925b7a467e4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1314 microversion: 2.1 time: 0.485370 Jan 19 16:27:04.760199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 176/369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:04 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:04.769804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:04.771023 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:04.784013 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:04.792820 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:04.794254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:04.795051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:05.300016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:05.321703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c052d916-3d52-4a0a-a1cc-8786c5dba5c4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1277 microversion: 2.1 time: 0.704517 Jan 19 16:27:05.322903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 194/370] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:04 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1277 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:05.345898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:05.348006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:05.370056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:05.379645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:05.380977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:05.382473 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-053f4d75-b41f-42dc-9133-256bedf19ce9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.620130 Jan 19 16:27:05.384307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:05.385207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:05.400831 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 177/371] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:05.412034 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:05.413347 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:05.427892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:05.428366 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:05.429310 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:05.429765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:05.993889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:06.016901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:06.026423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:06.037188 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:06.039386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-eab8f8d4-6257-4bf9-aa3a-7499c9728e57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.637053 Jan 19 16:27:06.040905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 178/372] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:05 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:06.054823 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:06.055446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:06.063804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3e4ae57a-8918-4ca7-b5e6-b686b9e2a873 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1318 microversion: 2.1 time: 0.738121 Jan 19 16:27:06.065530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 195/373] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:05 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:06.069701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.070180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.071548 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.072056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.086371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:06.090699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:06.104666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.106197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.110473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.111843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.681474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:06.689762 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:06.691273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a1536eb-cbf5-4f3a-b7dd-ae7747b39154 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1497 microversion: 2.1 time: 0.623609 Jan 19 16:27:06.692396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 196/374] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:06 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1497 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:06.718911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-710ef719-dea3-482e-ade7-30eef8c78d6b req-55fdc96c-89ef-4f0e-b7f3-fb50ad66db89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805b0677-e780-415d-8ce6-ca4ec1a0817a", "tag": "94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:06.723420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:06.723420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:27:06.747075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-86d3eec3-2808-4766-ae8a-8950149d82d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.695854 Jan 19 16:27:06.747820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-710ef719-dea3-482e-ade7-30eef8c78d6b req-55fdc96c-89ef-4f0e-b7f3-fb50ad66db89 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.748435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-710ef719-dea3-482e-ade7-30eef8c78d6b req-55fdc96c-89ef-4f0e-b7f3-fb50ad66db89 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.754477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 179/375] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:06.779238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-710ef719-dea3-482e-ade7-30eef8c78d6b req-55fdc96c-89ef-4f0e-b7f3-fb50ad66db89 service nova] Creating event network-changed:94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87 for instance 805b0677-e780-415d-8ce6-ca4ec1a0817a on hv-cinder-78447 Jan 19 16:27:06.785682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-710ef719-dea3-482e-ade7-30eef8c78d6b req-55fdc96c-89ef-4f0e-b7f3-fb50ad66db89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076285 Jan 19 16:27:06.787097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:06.788643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 197/376] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:06.794621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:06.801481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:06.801481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:06.820373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.821925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.823188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.827865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.834455 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.835276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:06.836845 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:06.847862 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:07.472341 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:07.487005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:07.504185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4c15cb42-10ff-4f2a-bc0c-e8a353e9a23d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1277 microversion: 2.1 time: 0.729896 Jan 19 16:27:07.504185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 180/377] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:06 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1277 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:07.504185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-8f098133-d0bd-4c8b-a736-64fce168a176 req-9561ca5b-4039-450f-907a-f905ba1506be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd926e3-fc97-487a-b6aa-33983e63a1d7", "tag": "aa6e4e00-6dc4-4a81-8655-b0072a2d9ac8"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:07.504185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:07.504185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:27:07.521301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3460e5b3-019c-416a-9c44-79dad13bb0ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.728861 Jan 19 16:27:07.523786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 198/378] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:07.542055 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-8f098133-d0bd-4c8b-a736-64fce168a176 req-9561ca5b-4039-450f-907a-f905ba1506be service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:07.542362 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-8f098133-d0bd-4c8b-a736-64fce168a176 req-9561ca5b-4039-450f-907a-f905ba1506be service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:07.560918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:07.566683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:07.593620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:07.594356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:07.599301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-8f098133-d0bd-4c8b-a736-64fce168a176 req-9561ca5b-4039-450f-907a-f905ba1506be service nova] Creating event network-changed:aa6e4e00-6dc4-4a81-8655-b0072a2d9ac8 for instance 2fd926e3-fc97-487a-b6aa-33983e63a1d7 on hv-cinder-78447 Jan 19 16:27:07.612039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:07.613075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:07.622582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-8f098133-d0bd-4c8b-a736-64fce168a176 req-9561ca5b-4039-450f-907a-f905ba1506be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131805 Jan 19 16:27:07.624223 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 181/379] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:07.639073 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:07.644163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:07.664120 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:07.672240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:07.673798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:07.674604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:08.280031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:08.292047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:08.296753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:08.300547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:08.300824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f9df46be-cae7-44c7-bf4a-e1021bb1635f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1318 microversion: 2.1 time: 0.674730 Jan 19 16:27:08.303847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8088214d-adcc-4a89-bd70-d13dc028f74a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1724 microversion: 2.20 time: 0.777743 Jan 19 16:27:08.305391 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 182/380] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:07 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:08.305883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 199/381] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1724 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:08.320122 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:08.320122 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:08.336111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:08.336388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:08.337160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:08.337619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:08.340430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:08.344868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:08.351442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:08.352301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:08.353387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:08.354029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:08.370821 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Going to try to terminate instance {{(pid=116209) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:27:08.502416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d1a3e4cc-980f-45d4-ad67-15983a44c223 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 204 len: 0 microversion: 2.1 time: 0.194725 Jan 19 16:27:08.503990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 183/382] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:27:08 2022] DELETE /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:27:08.519248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:08.520019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:08.526724 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:08.527180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:08.528053 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:08.528656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:08.969016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:08.984463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fcb473d8-2df3-4f30-88b8-555af0bb2835 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1547 microversion: 2.1 time: 0.668663 Jan 19 16:27:08.985576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 200/383] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1547 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:08.993948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:08.994694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:09.004521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.005427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.006992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.007945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.044720 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.053308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b1ee972a-0503-4604-8e4d-6c236767fa2d tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1503 microversion: 2.1 time: 0.542592 Jan 19 16:27:09.053970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 184/384] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:08 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1503 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:09.059253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:09.060229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:09.069750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.070207 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.071129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.071576 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.252155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.267041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b75fa616-b0e1-4138-b13c-be2d3c79165f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.279026 Jan 19 16:27:09.268176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 201/385] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:08 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:09.277402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:09.278298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:09.289896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.290587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.292095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.292976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.299399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.311289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b5551d37-afa1-49b5-bb4c-6f6896966a1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.256189 Jan 19 16:27:09.312928 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 185/386] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:09.320775 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:09.321650 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:09.329313 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.329764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.330570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.331011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.407569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] HTTP exception thrown: Cannot 'detach_volume' instance e119b741-b721-47fa-a03f-be8689acf2fd while it is in vm_state rescued Jan 19 16:27:09.408334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Returning 409 to user: Cannot 'detach_volume' instance e119b741-b721-47fa-a03f-be8689acf2fd while it is in vm_state rescued {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:27:09.409239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bd78ea84-df90-4462-aae7-784f3cc4dc2d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments/4910f108-5f0d-4679-bc43-c6ab496fe166" status: 409 len: 152 microversion: 2.1 time: 0.139717 Jan 19 16:27:09.409926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 202/387] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:27:09 2022] DELETE /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments/4910f108-5f0d-4679-bc43-c6ab496fe166 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 19 16:27:09.415193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:09.415920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:09.421916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.422473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.423329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.423879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.498115 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.509256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f76fcb7e-a0d6-453f-b5ce-a45e38b8b25f tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1318 microversion: 2.1 time: 0.194296 Jan 19 16:27:09.511190 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 186/388] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:09 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:09.520071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1aeaefc1-d1be-4999-9b91-d95cf6cb712a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:09.521428 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1aeaefc1-d1be-4999-9b91-d95cf6cb712a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:09.530832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1aeaefc1-d1be-4999-9b91-d95cf6cb712a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.531505 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1aeaefc1-d1be-4999-9b91-d95cf6cb712a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.532691 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1aeaefc1-d1be-4999-9b91-d95cf6cb712a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.533139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1aeaefc1-d1be-4999-9b91-d95cf6cb712a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.600150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.609212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.611225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.612617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8c5e6d78-e401-424e-a6d1-669235bac703 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1745 microversion: 2.20 time: 0.201417 Jan 19 16:27:09.613356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 203/389] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:09 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:09.624648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1aeaefc1-d1be-4999-9b91-d95cf6cb712a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action" status: 202 len: 0 microversion: 2.1 time: 0.101049 Jan 19 16:27:09.624648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 187/390] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:27:09 2022] POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:27:09.624870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:09.624870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:09.630484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.630977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.631969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:09.632498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:09.904548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:09.916715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f0d372d0-552c-4d91-b580-bf37f20a80b6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1555 microversion: 2.1 time: 0.296640 Jan 19 16:27:09.924111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 204/391] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:10.074663 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:10.075516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:10.082368 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.083019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.084139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.084870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.287954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:10.288811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:10.295586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.296180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.297044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.297551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.369623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:10.378377 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-555acb9c-34f1-4390-a6d6-bcfab1b274b3 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1503 microversion: 2.1 time: 0.307540 Jan 19 16:27:10.379007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 188/392] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:10 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:10.383707 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:10.384329 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:10.400550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.401927 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.402965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.403409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.543694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:10.553890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-21affc95-c6d6-4691-9f87-a8c694b2eded tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.271181 Jan 19 16:27:10.554964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 205/393] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:10 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:10.565449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:10.566182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:10.572920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.573384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.574203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.574637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.623794 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:10.633364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6fd6e9dd-f84f-49c3-9b76-a4fcd19bb23c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.253225 Jan 19 16:27:10.633863 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 189/394] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:10.640281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:10.641132 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:10.650186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.650631 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.651741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.652047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.928319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:10.937485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-81fd5725-9608-4c53-98eb-a4659bd5a28e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1318 microversion: 2.1 time: 0.376401 Jan 19 16:27:10.951154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 206/395] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:10 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:10.951154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:10.951154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:10.951154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.951630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.951630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:10.952088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:10.985167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:10.995897 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:10.997346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:10.998906 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3e3ca4f4-867c-43ea-b409-b58d5cd9d26b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1745 microversion: 2.20 time: 0.363439 Jan 19 16:27:10.999715 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 190/396] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:10 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1745 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:11.209720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:11.218684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ae28ec1e-a61b-4f6d-b5c4-bd9a10996e55 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1555 microversion: 2.1 time: 0.279293 Jan 19 16:27:11.219278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 207/397] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:11.397200 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:11.397817 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:11.411328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.412520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.415703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.416826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.442454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-4c56126e-9167-40e2-a6e9-d5893c85dfb8 req-67f3194f-03e9-4f4a-9a8f-5b41e6e5b54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6663883a-5a77-452f-9783-f135c679d6e4", "name": "network-vif-deleted", "tag": "cfaaf6c6-4c1e-481a-a293-d4fd84e23f59"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:11.444285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:11.444285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:27:11.454150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-4c56126e-9167-40e2-a6e9-d5893c85dfb8 req-67f3194f-03e9-4f4a-9a8f-5b41e6e5b54d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.454686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-4c56126e-9167-40e2-a6e9-d5893c85dfb8 req-67f3194f-03e9-4f4a-9a8f-5b41e6e5b54d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.467836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-4c56126e-9167-40e2-a6e9-d5893c85dfb8 req-67f3194f-03e9-4f4a-9a8f-5b41e6e5b54d service nova] Creating event network-vif-deleted:cfaaf6c6-4c1e-481a-a293-d4fd84e23f59 for instance 6663883a-5a77-452f-9783-f135c679d6e4 on hv-cinder-78447 Jan 19 16:27:11.473700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-4c56126e-9167-40e2-a6e9-d5893c85dfb8 req-67f3194f-03e9-4f4a-9a8f-5b41e6e5b54d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Jan 19 16:27:11.474738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 208/398] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:11.558033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:11.568320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-857392d2-8963-46a6-8a91-3cb7f4fb3efd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 200 len: 1461 microversion: 2.1 time: 0.175564 Jan 19 16:27:11.568920 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 191/399] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:11 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 1461 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:11.582656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:11.584113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:11.592271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.593357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.594623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.595253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.653757 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:11.654687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:11.666569 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.667218 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.668089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.668594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.895609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:11.902322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:11.909360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d66b6fdc-e781-4b08-8347-2cfad2dc9f93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.334748 Jan 19 16:27:11.910034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 209/400] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:11 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:11.917240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6d22a483-cfa2-48bc-ac54-5777e52dba77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.269098 Jan 19 16:27:11.918058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 192/401] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:11.961518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:11.962724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:11.983421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.984331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:11.985728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:11.991952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-470e43d4-0201-455a-880f-8f0b739e1562 req-4213aceb-5fb1-49e4-b827-6b6a7b0e6ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b42b29d-6ec2-4fd8-b110-48af10080a11", "name": "network-vif-plugged", "status": "completed", "tag": "6cce95f3-aa82-488b-8999-5b073fe0fc80"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:11.994016 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:11.994016 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:27:11.997861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.014724 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-470e43d4-0201-455a-880f-8f0b739e1562 req-4213aceb-5fb1-49e4-b827-6b6a7b0e6ccd service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.014979 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-470e43d4-0201-455a-880f-8f0b739e1562 req-4213aceb-5fb1-49e4-b827-6b6a7b0e6ccd service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.048764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-470e43d4-0201-455a-880f-8f0b739e1562 req-4213aceb-5fb1-49e4-b827-6b6a7b0e6ccd service nova] Creating event network-vif-plugged:6cce95f3-aa82-488b-8999-5b073fe0fc80 for instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 on hv-cinder-78447 Jan 19 16:27:12.058904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-470e43d4-0201-455a-880f-8f0b739e1562 req-4213aceb-5fb1-49e4-b827-6b6a7b0e6ccd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069315 Jan 19 16:27:12.059555 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 193/402] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:12.067356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:12.068172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:12.079127 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.079975 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.080998 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.081617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.429252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:12.435448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:12.440763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:12.443561 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:12.445232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1f685e06-71f5-4352-bb2b-ae9df3139b98 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.384534 Jan 19 16:27:12.446546 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 194/403] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:12.449295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ac0e4e4-7935-467c-af07-a6b3eabe9925 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1318 microversion: 2.1 time: 0.494005 Jan 19 16:27:12.452900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:12.453710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:12.463872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 210/404] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:11 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:12.465736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.466399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.467250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.467723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.587617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:12.588687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 6663883a-5a77-452f-9783-f135c679d6e4] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:12.597948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.599167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.601143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.602033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.621441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] HTTP exception thrown: Instance 6663883a-5a77-452f-9783-f135c679d6e4 could not be found. Jan 19 16:27:12.622320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Returning 404 to user: Instance 6663883a-5a77-452f-9783-f135c679d6e4 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:27:12.623286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-568cb66f-e904-4504-bb73-898f43bdedf4 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4" status: 404 len: 111 microversion: 2.1 time: 0.040035 Jan 19 16:27:12.624343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 211/405] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:12 2022] GET /compute/v2.1/servers/6663883a-5a77-452f-9783-f135c679d6e4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:27:12.702806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:12.718667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b39c569b-fcec-4dcd-ba6b-f1f1dae116ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1555 microversion: 2.1 time: 0.269377 Jan 19 16:27:12.720357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 195/406] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:12.762841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-333466060", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "df5b9818-486b-449f-affc-04a3bbff76f3"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:12.851714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] validate_networks() for [('df5b9818-486b-449f-affc-04a3bbff76f3', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:27:12.963819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:12.966835 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:12.976909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.977737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:12.978749 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:12.979410 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.338358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:13.354963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5e3ff1d4-3281-4d73-b748-c86427d26a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.400943 Jan 19 16:27:13.355895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 196/407] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:12 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:13.361033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:13.362091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:13.368869 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.375447 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.376426 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.376986 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.522712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:27:13.523338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:27:13.523587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:27:13.524016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:27:13.524418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:27:13.545566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.546805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.548443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.549611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.585988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Getting quotas for project 15f0fb14f0904844a6eb3b141098a26e. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:27:13.592167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Getting quotas for user 131440980fb64308b818f7dd667ec70c and project 15f0fb14f0904844a6eb3b141098a26e. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:27:13.612642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:27:13.615114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:27:13.616744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:13.627201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bfd18b97-e716-4f20-8186-d0ce0a2de14f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.269952 Jan 19 16:27:13.628387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 197/408] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:13.634555 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:13.635180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:13.643038 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.643952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.645473 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.646827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.692527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e9d38af4-c29c-4a8e-afd6-85976ea23d8c tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932683 Jan 19 16:27:13.699440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 212/409] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:27:13.702195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:13.703038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:13.711585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.712421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:13.713720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:13.714358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.050929 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:14.072267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:14.075778 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:14.078748 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:14.081707 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0635fed0-7501-41ea-8616-6e1ae556af2d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.451351 Jan 19 16:27:14.082359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 198/410] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:14.103712 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1c26eda5-ba3c-4f6a-a760-ed4fed82abb8 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:14.106552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1c26eda5-ba3c-4f6a-a760-ed4fed82abb8 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:14.113509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a22f073-59e8-460d-a88d-9c4148258747 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1318 microversion: 2.1 time: 0.416047 Jan 19 16:27:14.114696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 213/411] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:13 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:14.133739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:14.137258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:14.160032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.162065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.166219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.172031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.231995 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1c26eda5-ba3c-4f6a-a760-ed4fed82abb8 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:14.246396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1c26eda5-ba3c-4f6a-a760-ed4fed82abb8 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1213 microversion: 2.1 time: 0.161503 Jan 19 16:27:14.264702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 199/412] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:14 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:14.284137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-bf4023af-aa31-40ec-bbae-523ad50f8d40 req-dda342f7-c1cf-4233-be54-0327df0b2c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd926e3-fc97-487a-b6aa-33983e63a1d7", "name": "network-vif-plugged", "status": "completed", "tag": "aa6e4e00-6dc4-4a81-8655-b0072a2d9ac8"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:14.289056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:14.289056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:27:14.305705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-bf4023af-aa31-40ec-bbae-523ad50f8d40 req-dda342f7-c1cf-4233-be54-0327df0b2c52 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.306420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-bf4023af-aa31-40ec-bbae-523ad50f8d40 req-dda342f7-c1cf-4233-be54-0327df0b2c52 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.328580 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-bf4023af-aa31-40ec-bbae-523ad50f8d40 req-dda342f7-c1cf-4233-be54-0327df0b2c52 service nova] Creating event network-vif-plugged:aa6e4e00-6dc4-4a81-8655-b0072a2d9ac8 for instance 2fd926e3-fc97-487a-b6aa-33983e63a1d7 on hv-cinder-78447 Jan 19 16:27:14.346390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-bf4023af-aa31-40ec-bbae-523ad50f8d40 req-dda342f7-c1cf-4233-be54-0327df0b2c52 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079815 Jan 19 16:27:14.347187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 200/413] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:14.392154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:14.393003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:14.402688 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.403471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.404828 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.405594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.506211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:14.535937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9e03f94-c2c0-4a52-9d9b-3ae0c70866b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1561 microversion: 2.1 time: 0.418557 Jan 19 16:27:14.538057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 214/414] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1561 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:14.657688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:14.658652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:14.669916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.672509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.676952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.684252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.903619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:14.919023 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-647e6bce-5a82-4615-b89c-bd752bc2b907 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.539731 Jan 19 16:27:14.930017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 201/415] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:14 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:14.937118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:14.938004 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:14.948850 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.949812 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:14.951064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:14.951735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.026861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:15.042702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8ebac083-0db1-4164-9c63-54309c862427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.388587 Jan 19 16:27:15.044413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 215/416] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:15.083659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.objects.instance [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lazy-loading 'services' on Instance uuid e119b741-b721-47fa-a03f-be8689acf2fd {{(pid=116209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:27:15.114908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:15.115812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:15.123101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.124039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.125117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.125751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.189075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-49c0bba0-e277-4d03-a027-8af5af8081e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments/4910f108-5f0d-4679-bc43-c6ab496fe166" status: 202 len: 0 microversion: 2.1 time: 0.256659 Jan 19 16:27:15.189985 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 202/417] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:27:14 2022] DELETE /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments/4910f108-5f0d-4679-bc43-c6ab496fe166 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:27:15.198932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:15.200682 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:15.213091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.214174 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.215593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.216234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.542941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:15.551885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:15.553971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:15.555525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f6c097b1-acf8-407f-a9d2-35a8e9891709 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.445017 Jan 19 16:27:15.556236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 216/418] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:15 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:15.561288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-28a833fd-87d7-4d4d-b9bf-bc73df90261a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:15.562600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-28a833fd-87d7-4d4d-b9bf-bc73df90261a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:15.569601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a833fd-87d7-4d4d-b9bf-bc73df90261a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.570374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a833fd-87d7-4d4d-b9bf-bc73df90261a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.571245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a833fd-87d7-4d4d-b9bf-bc73df90261a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.571722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a833fd-87d7-4d4d-b9bf-bc73df90261a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.619271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-28a833fd-87d7-4d4d-b9bf-bc73df90261a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061733 Jan 19 16:27:15.619901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 217/419] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:15.622968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:15.632842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:15.633647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:15.639326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-967bd145-9a42-4899-9aab-d8208b97d6b4 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1318 microversion: 2.1 time: 0.447855 Jan 19 16:27:15.643446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 203/420] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:15 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:15.650795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.651559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.652910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.653567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.784723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:15.820504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c222088c-dac9-4781-8d79-e9454b0b8c33 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1273 microversion: 2.1 time: 0.199099 Jan 19 16:27:15.821592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 218/421] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:15 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:15.940891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:15.942761 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:15.955210 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.955723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:15.956837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:15.957281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.063820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:16.065244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:16.076812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.079255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.085706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.086133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.591298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:16.612158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:16.622515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45d7d6e4-8761-4224-b92f-13bb7a961e02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.562612 Jan 19 16:27:16.625872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 219/422] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:16.632243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:16.632870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:16.639193 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ee95dd71-0e54-41eb-8b14-4abc37b85b6b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.704234 Jan 19 16:27:16.640162 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 204/423] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:15 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:16.663193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.664152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-834464a5-142e-4917-adab-673eb0bc5497 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:16.664366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.666121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.666570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.666702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-834464a5-142e-4917-adab-673eb0bc5497 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:16.680420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-834464a5-142e-4917-adab-673eb0bc5497 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.682271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-834464a5-142e-4917-adab-673eb0bc5497 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.684094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-834464a5-142e-4917-adab-673eb0bc5497 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.685023 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-834464a5-142e-4917-adab-673eb0bc5497 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.739312 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-834464a5-142e-4917-adab-673eb0bc5497 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096641 Jan 19 16:27:16.740459 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 205/424] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:16.747600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:16.748293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:16.763356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.764653 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:16.772449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:16.773538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:17.022457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:17.048520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:17.062146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:17.063914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c53824a7-5846-439f-a6ab-764b36ea4d7c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.439789 Jan 19 16:27:17.065116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 220/425] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:17.083584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:17.092691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:17.108427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:17.109332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:17.110977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:17.111909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:17.132858 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:17.154351 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-70862b2c-457e-4722-8fcc-2152f5859a94 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1508 microversion: 2.1 time: 0.412334 Jan 19 16:27:17.183189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 206/426] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:16 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:17.334560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:17.352859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-18c417fd-1dcc-48be-9f19-0c20d10d0b7e tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1271 microversion: 2.1 time: 0.280566 Jan 19 16:27:17.353907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 221/427] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:17 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:17.652169 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:17.653060 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:17.665672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:17.673377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:17.677774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:17.681387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:17.681820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:17.683258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:17.684124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:17.684628 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:17.690120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:17.691234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:18.074645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:18.075393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:18.114369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f12b89d5-aad0-4275-8c0a-af79a5d35d0f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.454447 Jan 19 16:27:18.116173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5595beae-c498-4d58-9204-5c4b83cd3d84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.467182 Jan 19 16:27:18.134258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 207/428] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:18.135312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 222/429] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:17 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:18.140536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09ffeb90-1a49-4657-8ce4-34a5588ba871 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:18.141538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09ffeb90-1a49-4657-8ce4-34a5588ba871 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:18.149220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09ffeb90-1a49-4657-8ce4-34a5588ba871 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:18.149696 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:18.150183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09ffeb90-1a49-4657-8ce4-34a5588ba871 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:18.150396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:18.151001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09ffeb90-1a49-4657-8ce4-34a5588ba871 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:18.151455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09ffeb90-1a49-4657-8ce4-34a5588ba871 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:18.165576 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:18.166029 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:18.167627 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:18.168186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:18.193765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09ffeb90-1a49-4657-8ce4-34a5588ba871 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057338 Jan 19 16:27:18.194677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 223/430] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:18.371622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:18.372313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:18.388317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:18.389180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:18.391248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:18.392927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:18.493541 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:18.512040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:18.523315 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:18.529194 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cf703a27-f66d-4e01-8d1d-d649df155f77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.391870 Jan 19 16:27:18.530173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 208/431] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:18 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:18.786746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:18.803456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-19cc1bd7-cfbf-4687-a21d-22dff7477dbe tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1313 microversion: 2.1 time: 0.435550 Jan 19 16:27:18.804536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 224/432] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:18 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:19.124159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-d96f8e19-5c77-41ea-932c-311806ca67e7 req-71093fde-a8d3-4e40-bbd0-5e9c520f3524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b6bea3-3feb-4155-bea8-a36a587625b7", "tag": "fbe468e6-a1b8-4690-8a22-7310a3f16008"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:19.127767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:19.127767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:27:19.148464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:19.151822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:19.174043 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-d96f8e19-5c77-41ea-932c-311806ca67e7 req-71093fde-a8d3-4e40-bbd0-5e9c520f3524 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.175941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-d96f8e19-5c77-41ea-932c-311806ca67e7 req-71093fde-a8d3-4e40-bbd0-5e9c520f3524 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.183226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.183989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.185411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.187053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.212406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-d96f8e19-5c77-41ea-932c-311806ca67e7 req-71093fde-a8d3-4e40-bbd0-5e9c520f3524 service nova] Creating event network-changed:fbe468e6-a1b8-4690-8a22-7310a3f16008 for instance 03b6bea3-3feb-4155-bea8-a36a587625b7 on hv-cinder-78447 Jan 19 16:27:19.233739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-d96f8e19-5c77-41ea-932c-311806ca67e7 req-71093fde-a8d3-4e40-bbd0-5e9c520f3524 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113891 Jan 19 16:27:19.235535 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 209/433] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:19.242430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:19.243471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:19.251526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.252388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.253408 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.254041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.510953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:19.527294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-52a7c425-35e2-4636-a166-190d56122edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.388325 Jan 19 16:27:19.537400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 225/434] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:19 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:19.542113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ffedd03-bcec-4783-bafd-6ce466d6d4a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:19.543080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ffedd03-bcec-4783-bafd-6ce466d6d4a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:19.557082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ffedd03-bcec-4783-bafd-6ce466d6d4a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.557536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ffedd03-bcec-4783-bafd-6ce466d6d4a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.558341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ffedd03-bcec-4783-bafd-6ce466d6d4a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.558772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ffedd03-bcec-4783-bafd-6ce466d6d4a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.613427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ffedd03-bcec-4783-bafd-6ce466d6d4a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074656 Jan 19 16:27:19.618318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 226/435] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:19.623164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:19.624162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:19.635567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.635567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.636936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.637640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.766587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:19.775932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8ac770e5-11f5-4e14-b338-c56bcbefad7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.538643 Jan 19 16:27:19.785494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 210/436] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:19.822682 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:19.824324 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:19.831157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.832107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:19.833960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:19.834776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:20.107821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:20.120798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:20.122987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:20.124852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b1608e84-be04-409e-ba7c-db5ae87bf75e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.507658 Jan 19 16:27:20.143542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 227/437] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:20.175898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:20.201559 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-88a45ac3-61e3-4e9a-8ff3-52a09aff3d14 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1313 microversion: 2.1 time: 0.382336 Jan 19 16:27:20.202658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 211/438] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:19 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:20.544348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:20.545038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:20.552534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:20.552863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:20.553675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:20.554473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:20.626017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1fac4739-7309-4b02-8110-99cde48095dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:20.627299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1fac4739-7309-4b02-8110-99cde48095dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:20.635927 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fac4739-7309-4b02-8110-99cde48095dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:20.636457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fac4739-7309-4b02-8110-99cde48095dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:20.637219 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fac4739-7309-4b02-8110-99cde48095dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:20.637689 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fac4739-7309-4b02-8110-99cde48095dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:20.689874 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1fac4739-7309-4b02-8110-99cde48095dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067495 Jan 19 16:27:20.691024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 212/439] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:20.810307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:20.812316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:20.828709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:20.829443 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:20.830412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:20.831028 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:20.868821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:20.877040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c5044a34-bf29-47db-a0be-be655a5490ef tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.336251 Jan 19 16:27:20.887998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 228/440] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:20 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:21.014424 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:21.023870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-08909821-0f90-46f5-a8a7-a63d2af5e91c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.219519 Jan 19 16:27:21.026262 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 213/441] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:21.149739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:21.151044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:21.158707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.159268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:21.160645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.161843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:21.222756 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:21.224127 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:21.231282 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.232046 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:21.233007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.233593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:21.361870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:21.377849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:21.381773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:21.383484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c30cf995-b7bb-44ea-b210-fa7af3131700 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.242016 Jan 19 16:27:21.384424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 229/442] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:21 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:21.470668 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:21.490474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-22975da7-7155-4a00-b7a0-49517caade78 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1313 microversion: 2.1 time: 0.272221 Jan 19 16:27:21.491066 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 214/443] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:21 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:21.705973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e13258f8-9f29-4dfe-80b3-b43354233bdd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:21.708476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e13258f8-9f29-4dfe-80b3-b43354233bdd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:21.719979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e13258f8-9f29-4dfe-80b3-b43354233bdd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.720837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e13258f8-9f29-4dfe-80b3-b43354233bdd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:21.722835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e13258f8-9f29-4dfe-80b3-b43354233bdd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.724137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e13258f8-9f29-4dfe-80b3-b43354233bdd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:21.770595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e13258f8-9f29-4dfe-80b3-b43354233bdd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070951 Jan 19 16:27:21.771158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 230/444] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:21.894596 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:21.896585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:21.909263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.911012 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:21.913566 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:21.914446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.048517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:22.050203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:22.065781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.070078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.071193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.071756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.158683 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:22.168370 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-616594e9-2a16-4f9f-8af2-b46a29bc1196 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.277609 Jan 19 16:27:22.188127 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 215/445] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:21 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:22.291517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:22.300620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ded8fd00-a410-4c2b-9276-7d11ff2922d0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.258322 Jan 19 16:27:22.301309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 231/446] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:22.408954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:22.409590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:22.418469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.419210 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.420200 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.420780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.512645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:22.513394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:22.519550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.521793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.524135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.524821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.628944 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:22.638721 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:22.640645 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:22.642263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-84051ec9-722e-42c6-99dc-81a652b55bcc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.243057 Jan 19 16:27:22.654516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 216/447] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:22 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:22.784071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6369d934-3054-488d-83d4-e9f2e371bad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:22.785960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6369d934-3054-488d-83d4-e9f2e371bad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:22.792859 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6369d934-3054-488d-83d4-e9f2e371bad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.795166 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6369d934-3054-488d-83d4-e9f2e371bad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.796399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6369d934-3054-488d-83d4-e9f2e371bad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:22.797099 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6369d934-3054-488d-83d4-e9f2e371bad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:22.821531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:22.835137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6369d934-3054-488d-83d4-e9f2e371bad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055563 Jan 19 16:27:22.839114 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 217/448] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:22.840102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9ed67918-144b-4fb1-9a4c-3cab3828a876 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1313 microversion: 2.1 time: 0.329477 Jan 19 16:27:22.843552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 232/449] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:22 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:23.195845 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:23.196460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:23.203244 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.203714 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.204538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.204983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.324828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:23.327122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:23.339152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.339617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.340639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.341217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.399622 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:23.413127 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-806e80e3-5176-40ac-94f9-d6f1ed69a116 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.220921 Jan 19 16:27:23.413960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 218/450] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:23 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:23.511005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:23.524608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aa52d5ed-526d-424a-9534-5ff5de241ac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.206686 Jan 19 16:27:23.525199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 233/451] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:23.663332 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:23.663969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:23.673805 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.674539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.676270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.690121 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.849703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d326a0e-fce2-4df4-bbcb-885fef7bbc5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:23.850999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d326a0e-fce2-4df4-bbcb-885fef7bbc5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:23.859015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d326a0e-fce2-4df4-bbcb-885fef7bbc5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.864578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d326a0e-fce2-4df4-bbcb-885fef7bbc5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.866128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d326a0e-fce2-4df4-bbcb-885fef7bbc5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:23.866812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d326a0e-fce2-4df4-bbcb-885fef7bbc5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:23.933897 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:23.943537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d326a0e-fce2-4df4-bbcb-885fef7bbc5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097453 Jan 19 16:27:23.946152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:23.948831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 234/452] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:23.949720 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:23.950909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5c41681c-793e-472f-b744-e6ba80f4fed1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1740 microversion: 2.20 time: 0.293033 Jan 19 16:27:23.955439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 219/453] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:23 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:23.966309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:23.969586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:24.000297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.000879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.008658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.009244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.237170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:24.252168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-34f096db-809b-42c3-9f98-cae825f1fbf6 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1313 microversion: 2.1 time: 0.301454 Jan 19 16:27:24.253269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 235/454] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:23 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:24.437879 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:24.438534 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:24.445502 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.446044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.446867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.447300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.542290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:24.543093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:24.549429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.549874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.550665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.551314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.645898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:24.653736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b910f47b-3ba9-492d-af96-2ab331c9ce12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.219488 Jan 19 16:27:24.654327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 220/455] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:24 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:24.716254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:24.724863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3f21f06d-c7b6-4db8-a1ab-b33057f17c43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.186653 Jan 19 16:27:24.725507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 236/456] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:24.960793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ee7c23a4-0abd-4db2-aeba-4b4acfa6c9a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:24.961917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ee7c23a4-0abd-4db2-aeba-4b4acfa6c9a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:24.969001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee7c23a4-0abd-4db2-aeba-4b4acfa6c9a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.969453 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee7c23a4-0abd-4db2-aeba-4b4acfa6c9a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.970247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee7c23a4-0abd-4db2-aeba-4b4acfa6c9a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.970687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee7c23a4-0abd-4db2-aeba-4b4acfa6c9a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.971288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:24.971940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:24.979025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.979624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:24.980451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:24.980877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:25.006497 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ee7c23a4-0abd-4db2-aeba-4b4acfa6c9a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049232 Jan 19 16:27:25.007107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 221/457] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:25.239175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:25.247379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:25.248940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:25.250098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8149665a-3798-4456-8157-ef13101e9d60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1722 microversion: 2.20 time: 0.284068 Jan 19 16:27:25.250874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 237/458] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:24 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:25.276669 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:25.277281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:25.283448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:25.283936 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:25.284790 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:25.285496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:25.673969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:25.674864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:25.685120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:25.685596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:25.687342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:25.688032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:25.752960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:25.760739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1fe75def-7e53-4b46-abcb-491916399047 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1313 microversion: 2.1 time: 0.487688 Jan 19 16:27:25.761332 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 222/459] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:25 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:25.766181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:25.766853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:25.776070 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:25.776529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:25.777368 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:25.777779 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:25.972053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:25.980355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7ff4e03-91fa-439b-a3c4-015b50547cf6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.312474 Jan 19 16:27:25.981365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 238/460] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:25 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:26.013303 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:26.023065 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ec589233-d140-49b9-96fb-a7b64194d02d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.260638 Jan 19 16:27:26.024430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 223/461] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:26.024758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-4c68fc05-092e-4e67-a454-f22ce1c4dc12 req-2c44bec8-e214-4d82-9f6e-1122076e116d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b6bea3-3feb-4155-bea8-a36a587625b7", "name": "network-vif-plugged", "status": "completed", "tag": "fbe468e6-a1b8-4690-8a22-7310a3f16008"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:26.027738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:26.027738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:27:26.031084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d5f1d65a-4b06-4662-abf4-d5cc9b62964a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:26.032345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d5f1d65a-4b06-4662-abf4-d5cc9b62964a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:26.040731 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d5f1d65a-4b06-4662-abf4-d5cc9b62964a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:26.041186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d5f1d65a-4b06-4662-abf4-d5cc9b62964a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:26.041800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-4c68fc05-092e-4e67-a454-f22ce1c4dc12 req-2c44bec8-e214-4d82-9f6e-1122076e116d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:26.042150 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d5f1d65a-4b06-4662-abf4-d5cc9b62964a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:26.042373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-4c68fc05-092e-4e67-a454-f22ce1c4dc12 req-2c44bec8-e214-4d82-9f6e-1122076e116d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:26.043216 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d5f1d65a-4b06-4662-abf4-d5cc9b62964a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:26.055838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-4c68fc05-092e-4e67-a454-f22ce1c4dc12 req-2c44bec8-e214-4d82-9f6e-1122076e116d service nova] Creating event network-vif-plugged:fbe468e6-a1b8-4690-8a22-7310a3f16008 for instance 03b6bea3-3feb-4155-bea8-a36a587625b7 on hv-cinder-78447 Jan 19 16:27:26.062051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-4c68fc05-092e-4e67-a454-f22ce1c4dc12 req-2c44bec8-e214-4d82-9f6e-1122076e116d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050297 Jan 19 16:27:26.062969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 239/462] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:26.088199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d5f1d65a-4b06-4662-abf4-d5cc9b62964a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060376 Jan 19 16:27:26.089527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 224/463] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:26.270835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:26.271587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:26.278596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:26.279086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:26.279917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:26.280841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:26.443532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:26.451661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:26.453175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:26.454331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-88191af7-82c5-4f5d-a2b9-6fdeb9d4540d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1722 microversion: 2.20 time: 0.188739 Jan 19 16:27:26.454888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 240/464] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:26 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:26.781924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:26.782931 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:26.793323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:26.794109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:26.795427 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:26.796234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:26.998567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:26.999433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:27.007296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.007878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.008851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.009419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.124206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:27.133386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8de63a99-a2e1-40ff-8b97-b352d041b42f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1313 microversion: 2.1 time: 0.358183 Jan 19 16:27:27.133993 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 225/465] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:26 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:27.138694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:27.139563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:27.149557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.150696 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.152457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.153309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.324379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:27.337997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-27d790a7-a5fe-455e-aa1c-bed95cc455b9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.342940 Jan 19 16:27:27.338885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 241/466] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:26 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:27.345168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a4569b5b-b84c-4cf7-8630-0e09c67741cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:27.347220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a4569b5b-b84c-4cf7-8630-0e09c67741cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:27.355663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4569b5b-b84c-4cf7-8630-0e09c67741cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.356673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4569b5b-b84c-4cf7-8630-0e09c67741cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.357786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4569b5b-b84c-4cf7-8630-0e09c67741cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.358417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4569b5b-b84c-4cf7-8630-0e09c67741cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.397944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a4569b5b-b84c-4cf7-8630-0e09c67741cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056969 Jan 19 16:27:27.398548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 242/467] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:27.478305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:27.479427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:27.488888 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:27.491404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.492168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.493614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:27.494199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:27.500421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ae8fa640-4bba-469f-b461-dfbf62a58d18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1722 microversion: 2.1 time: 0.364538 Jan 19 16:27:27.501382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 226/468] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:27.667599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:27.676666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:27.678216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:27.679442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3c6ddba-6df2-4257-a115-895f38a5e8e7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1722 microversion: 2.20 time: 0.209285 Jan 19 16:27:27.680089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 243/469] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:27 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:28.086414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-2e938d83-96c4-4107-b5b5-7c6309a16fca req-1973f7f9-4a9e-4941-a469-a1b362d3612c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b42b29d-6ec2-4fd8-b110-48af10080a11", "name": "network-vif-unplugged", "status": "completed", "tag": "6cce95f3-aa82-488b-8999-5b073fe0fc80"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:28.088792 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:27:28.088792 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:27:28.097509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-2e938d83-96c4-4107-b5b5-7c6309a16fca req-1973f7f9-4a9e-4941-a469-a1b362d3612c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.098061 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-2e938d83-96c4-4107-b5b5-7c6309a16fca req-1973f7f9-4a9e-4941-a469-a1b362d3612c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.111286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-2e938d83-96c4-4107-b5b5-7c6309a16fca req-1973f7f9-4a9e-4941-a469-a1b362d3612c service nova] Creating event network-vif-unplugged:6cce95f3-aa82-488b-8999-5b073fe0fc80 for instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 on hv-cinder-78447 Jan 19 16:27:28.117232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-2e938d83-96c4-4107-b5b5-7c6309a16fca req-1973f7f9-4a9e-4941-a469-a1b362d3612c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035935 Jan 19 16:27:28.118165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 227/470] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:28.164023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:28.165400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:28.180007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.181435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.184182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.184987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.389058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:28.390002 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:28.400726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.401607 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.403023 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.403812 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.430023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '131440980fb64308b818f7dd667ec70c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f0fb14f0904844a6eb3b141098a26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:28.438080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-16a48643-2820-4cc8-b818-4964e36bfbcb tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 200 len: 1497 microversion: 2.1 time: 0.282307 Jan 19 16:27:28.438759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 244/471] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:28 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:28.451102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a97b5c3c-c5f7-4bdf-9969-6f5b09e1b3d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:28.453721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a97b5c3c-c5f7-4bdf-9969-6f5b09e1b3d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:28.464184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a97b5c3c-c5f7-4bdf-9969-6f5b09e1b3d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.465185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a97b5c3c-c5f7-4bdf-9969-6f5b09e1b3d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.466288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a97b5c3c-c5f7-4bdf-9969-6f5b09e1b3d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.467297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a97b5c3c-c5f7-4bdf-9969-6f5b09e1b3d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.503884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a97b5c3c-c5f7-4bdf-9969-6f5b09e1b3d4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063752 Jan 19 16:27:28.504787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 245/472] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:28.525064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:28.526151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:28.534247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.534713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.536700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.537626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.648496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:28.660716 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f30f5b00-2a8a-4634-b910-b5de3935c50b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.291456 Jan 19 16:27:28.661759 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 228/473] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:28 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:28.701568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:28.702425 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:28.710876 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.711328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.712194 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.712634 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.743584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:28.758229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4bc1baae-ab97-4f53-9f08-f7287727d238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1699 microversion: 2.1 time: 0.237283 Jan 19 16:27:28.759408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 246/474] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1699 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:28.776678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e650c387-40b4-44ca-93d9-8ed39944b592 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:28.786680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e650c387-40b4-44ca-93d9-8ed39944b592 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.787122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e650c387-40b4-44ca-93d9-8ed39944b592 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.856065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e650c387-40b4-44ca-93d9-8ed39944b592 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Going to try to start instance {{(pid=116210) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 19 16:27:28.919011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e650c387-40b4-44ca-93d9-8ed39944b592 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 202 len: 0 microversion: 2.1 time: 0.146016 Jan 19 16:27:28.919893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 247/475] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:27:28 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:27:28.928366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:28.929100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:28.938777 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:28.943497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.943999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.947580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.948071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.954485 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:28.956469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:28.958605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b29f940e-caf1-417a-bfc0-2dc22013f5d5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1725 microversion: 2.20 time: 0.262957 Jan 19 16:27:28.959256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 229/476] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:28 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:28.980344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2de30d46-1a94-4b9e-ae24-bc12ae479840 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23c880a0-48ff-4e57-86f9-b1f98bf45533"}} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:28.981566 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2de30d46-1a94-4b9e-ae24-bc12ae479840 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:28.989285 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2de30d46-1a94-4b9e-ae24-bc12ae479840 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.989802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2de30d46-1a94-4b9e-ae24-bc12ae479840 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:28.990802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2de30d46-1a94-4b9e-ae24-bc12ae479840 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:28.991253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2de30d46-1a94-4b9e-ae24-bc12ae479840 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.170139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:29.180667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2dba6db0-d41d-4c5e-b40e-9ba69598a516 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1708 microversion: 2.1 time: 0.256412 Jan 19 16:27:29.181716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 248/477] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1708 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:29.421693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2de30d46-1a94-4b9e-ae24-bc12ae479840 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.445706 Jan 19 16:27:29.423143 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 230/478] 10.222.0.42 () {62 vars in 1363 bytes} [Wed Jan 19 16:27:28 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments => generated 188 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:27:29.518554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4ec0adb-d732-4302-9770-5fb57d2aa294 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:29.520313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4ec0adb-d732-4302-9770-5fb57d2aa294 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:29.526488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4ec0adb-d732-4302-9770-5fb57d2aa294 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.534640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4ec0adb-d732-4302-9770-5fb57d2aa294 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.534640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4ec0adb-d732-4302-9770-5fb57d2aa294 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.534640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4ec0adb-d732-4302-9770-5fb57d2aa294 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.565833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4ec0adb-d732-4302-9770-5fb57d2aa294 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051324 Jan 19 16:27:29.567310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 249/479] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:29.602809 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-694d6266-0956-4ee3-a6aa-55ec6aa2c7c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:27:29.603383 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-694d6266-0956-4ee3-a6aa-55ec6aa2c7c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:29.611090 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-694d6266-0956-4ee3-a6aa-55ec6aa2c7c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.611611 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-694d6266-0956-4ee3-a6aa-55ec6aa2c7c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.612642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-694d6266-0956-4ee3-a6aa-55ec6aa2c7c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.613267 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-694d6266-0956-4ee3-a6aa-55ec6aa2c7c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.685218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:29.685685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:29.692446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.692990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.693923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.694503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.729574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-694d6266-0956-4ee3-a6aa-55ec6aa2c7c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action" status: 202 len: 0 microversion: 2.20 time: 0.130512 Jan 19 16:27:29.730664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 231/480] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:27:29 2022] POST /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:27:29.739079 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:29.740076 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:29.747308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.748150 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.749193 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:29.749871 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:29.995021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:30.005304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5085573b-15df-4e27-96bb-e527071e366a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.325196 Jan 19 16:27:30.012759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 250/481] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:29 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:30.021466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:30.036318 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:30.039526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:30.041781 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-341020ad-ebd3-4b59-8fb6-d27cbcfca86d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1751 microversion: 2.20 time: 0.306701 Jan 19 16:27:30.042795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 232/482] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:29 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1751 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:30.202261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:30.203183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:30.214348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:30.215186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:30.216678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:30.217487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:30.426540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:30.443632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8a170d60-26eb-4608-b6c4-ac3297003c16 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1708 microversion: 2.1 time: 0.245938 Jan 19 16:27:30.444842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 251/483] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1708 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:30.584380 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d234cf7a-974b-418a-9daa-f3b99704c824 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:30.584380 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d234cf7a-974b-418a-9daa-f3b99704c824 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:30.593802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d234cf7a-974b-418a-9daa-f3b99704c824 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:30.594410 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d234cf7a-974b-418a-9daa-f3b99704c824 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:30.595747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d234cf7a-974b-418a-9daa-f3b99704c824 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:30.596793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d234cf7a-974b-418a-9daa-f3b99704c824 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:30.647969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d234cf7a-974b-418a-9daa-f3b99704c824 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073173 Jan 19 16:27:30.649427 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 233/484] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:31.028405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:31.028990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:31.035852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.036301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.037110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.037567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.061943 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:31.062561 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:31.072256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.072692 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.073488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.073918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.275300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:31.280447 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:31.285065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ba19744-5009-48f1-8c4c-9968a2320fc0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.260318 Jan 19 16:27:31.285930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 252/485] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:31 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:31.291075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:31.292899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:31.294227 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-758f6e09-412a-43f4-9502-0ffba314fb3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.236417 Jan 19 16:27:31.294923 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 234/486] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:31 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:31.465005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:31.465615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:31.471778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.472234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.473030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.473475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.628824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:31.639092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9eb00c74-2793-484a-9099-0aff5a8d5384 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1708 microversion: 2.1 time: 0.177807 Jan 19 16:27:31.639715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 253/487] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1708 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:27:31.661254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ae39c4c0-a4c7-4816-af83-d63c799d0095 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:31.662355 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ae39c4c0-a4c7-4816-af83-d63c799d0095 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:31.669249 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae39c4c0-a4c7-4816-af83-d63c799d0095 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.669832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae39c4c0-a4c7-4816-af83-d63c799d0095 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.670727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae39c4c0-a4c7-4816-af83-d63c799d0095 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:31.671262 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ae39c4c0-a4c7-4816-af83-d63c799d0095 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:31.703575 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ae39c4c0-a4c7-4816-af83-d63c799d0095 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Jan 19 16:27:31.704188 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 235/488] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:32.302511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:32.303143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:32.309896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.310588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.311151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.311596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.314320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:32.314926 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:32.320999 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.321443 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.322223 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.322655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.523135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:32.526518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:32.530940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-924106a7-52a9-4b0d-994e-945fcbf39cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.232074 Jan 19 16:27:32.531603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 254/489] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:32 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:32.534957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:32.536655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:32.537789 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-558a1e9d-0825-44b1-b8c2-83332a524f7f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.227254 Jan 19 16:27:32.538335 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 236/490] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:32 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:32.664923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:32.665532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:32.671346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.671829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.672630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.673070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.714624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6e60ac15-714b-4c18-b1d8-b5ed3947c042 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:32.715563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6e60ac15-714b-4c18-b1d8-b5ed3947c042 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:32.722619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6e60ac15-714b-4c18-b1d8-b5ed3947c042 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.723366 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6e60ac15-714b-4c18-b1d8-b5ed3947c042 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.724247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6e60ac15-714b-4c18-b1d8-b5ed3947c042 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:32.724693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6e60ac15-714b-4c18-b1d8-b5ed3947c042 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:32.757656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6e60ac15-714b-4c18-b1d8-b5ed3947c042 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 Jan 19 16:27:32.758248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 237/491] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:32.840284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:32.848955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d041f9eb-d8c9-4e43-b646-dd22048f2274 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1708 microversion: 2.1 time: 0.187479 Jan 19 16:27:32.849571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 255/492] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1708 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:33.548345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:33.548958 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:33.555971 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.556425 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:33.556696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:33.557382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.557543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:33.557683 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:33.564254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.564713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:33.565536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.565980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:33.772479 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:33.774651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:33.784198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-50c86814-5fff-4009-bf88-0388b7596981 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.239526 Jan 19 16:27:33.784722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:33.784881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 238/493] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:33 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:33.789461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a2c9b956-599e-4f17-a521-36674f785641 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:33.789663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:33.790578 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a2c9b956-599e-4f17-a521-36674f785641 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:33.790889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-30d210ee-2eda-444c-9677-675768582172 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.238203 Jan 19 16:27:33.791649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 256/494] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:33 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:33.796749 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2c9b956-599e-4f17-a521-36674f785641 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.797385 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2c9b956-599e-4f17-a521-36674f785641 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:33.801081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2c9b956-599e-4f17-a521-36674f785641 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.801081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2c9b956-599e-4f17-a521-36674f785641 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:33.829206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a2c9b956-599e-4f17-a521-36674f785641 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043131 Jan 19 16:27:33.829766 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 239/495] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:33.867295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:33.867946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:33.874511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.874950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:33.875773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:33.876208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:34.022225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:34.032987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4798158-453b-4155-93b3-506d5195d3a2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1708 microversion: 2.1 time: 0.169789 Jan 19 16:27:34.034419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 257/496] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1708 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:34.800716 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:34.801298 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:34.807881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:34.808383 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:34.809159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:34.809595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:34.818548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:34.819334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:34.832439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:34.833243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:34.834681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:34.835494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:35.016508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:35.024460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-99fd0113-4dff-4326-9abe-ca0e441c27de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.227535 Jan 19 16:27:35.024693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:35.025751 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 240/497] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:34 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:35.031104 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-caf12dd7-45c0-4023-9ab1-a51207afc297 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:35.032449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-caf12dd7-45c0-4023-9ab1-a51207afc297 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:35.036507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:35.038255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:35.038898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-caf12dd7-45c0-4023-9ab1-a51207afc297 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:35.039354 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-caf12dd7-45c0-4023-9ab1-a51207afc297 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:35.039633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-33701502-3f8f-44db-bd4c-7780e64c0241 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.227296 Jan 19 16:27:35.040173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-caf12dd7-45c0-4023-9ab1-a51207afc297 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:35.040625 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-caf12dd7-45c0-4023-9ab1-a51207afc297 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:35.040754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 258/498] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:34 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:35.060322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:35.061488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:35.071204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:35.072235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:35.073690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:35.074638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:35.080409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-caf12dd7-45c0-4023-9ab1-a51207afc297 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053163 Jan 19 16:27:35.083007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 241/499] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:35.220598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:35.229973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-55527cd6-fca2-4cc7-88ed-a995f9a579dc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1712 microversion: 2.1 time: 0.176446 Jan 19 16:27:35.230547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 259/500] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1712 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:36.043126 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:36.043975 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:36.052938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:36.053569 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:36.054801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:36.055393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:36.061828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:36.062664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:36.069555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:36.070014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:36.070817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:36.071259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:36.503132 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:36.508036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:36.514089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5cf33414-f5cf-4e68-b46b-74d354044109 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.475493 Jan 19 16:27:36.515621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 242/501] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:36 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:36.524717 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5fd4a2a1-7c3e-4621-9e27-d598ebde325c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:36.524717 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5fd4a2a1-7c3e-4621-9e27-d598ebde325c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:36.526010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:36.526782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fd4a2a1-7c3e-4621-9e27-d598ebde325c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:36.527246 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fd4a2a1-7c3e-4621-9e27-d598ebde325c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:36.527581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:36.528185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fd4a2a1-7c3e-4621-9e27-d598ebde325c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:36.528629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fd4a2a1-7c3e-4621-9e27-d598ebde325c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:36.528835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f243e66a-965d-43c7-ab2a-c41fc981252e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.474186 Jan 19 16:27:36.529411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 260/502] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:36 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:36.560784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5fd4a2a1-7c3e-4621-9e27-d598ebde325c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Jan 19 16:27:36.561369 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 243/503] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:37.532075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:37.532695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:37.540126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:37.540584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:37.541552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:37.541999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:37.548066 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:37.548873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:37.555657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:37.556137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:37.556921 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:37.557356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:37.744562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:37.751950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d03073d8-ee1e-417b-b08c-d0bb94f99575 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.223765 Jan 19 16:27:37.752517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 261/504] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:37 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:37.756499 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:37.757402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2f358943-8afd-4f79-9eca-3c50ad883e58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:37.758486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2f358943-8afd-4f79-9eca-3c50ad883e58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:37.764342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f358943-8afd-4f79-9eca-3c50ad883e58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:37.764792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f358943-8afd-4f79-9eca-3c50ad883e58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:37.765248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:37.765580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f358943-8afd-4f79-9eca-3c50ad883e58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:37.766018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f358943-8afd-4f79-9eca-3c50ad883e58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:37.766731 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:37.767941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5dfd27fd-3a84-4940-9d29-7db2df583f57 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.223582 Jan 19 16:27:37.768497 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 244/505] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:37 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:37.795730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2f358943-8afd-4f79-9eca-3c50ad883e58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 Jan 19 16:27:37.796202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 262/506] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:38.768658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:38.769259 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:38.775663 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:38.776136 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:38.776921 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:38.777354 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:38.786360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:38.786958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:38.793375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:38.793822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:38.794609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:38.795046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:38.974418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:38.981709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-57bd43cf-e6ab-4dc4-b123-6552b2c21ad8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.216815 Jan 19 16:27:38.982107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:38.985059 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 245/507] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:38 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:38.991404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:38.992954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:38.994259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2b7bdd9d-2a48-45ab-9608-e295bb9a0456 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.211911 Jan 19 16:27:38.994803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 263/508] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:38 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:38.994999 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-da8dc885-f040-4b3e-8eec-ef6a6a7fa6ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:38.996197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-da8dc885-f040-4b3e-8eec-ef6a6a7fa6ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:39.002290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da8dc885-f040-4b3e-8eec-ef6a6a7fa6ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:39.002747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da8dc885-f040-4b3e-8eec-ef6a6a7fa6ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:39.003617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da8dc885-f040-4b3e-8eec-ef6a6a7fa6ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:39.004088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da8dc885-f040-4b3e-8eec-ef6a6a7fa6ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:39.032884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-da8dc885-f040-4b3e-8eec-ef6a6a7fa6ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049202 Jan 19 16:27:39.033454 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 246/509] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:39.998141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:39.998740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:40.005560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:40.006007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:40.006909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:40.007350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:40.012152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:40.012760 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:40.019481 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:40.019977 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:40.021344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:40.021790 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:40.199716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:40.207055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-05eaf77c-b7d8-420b-ab65-9141b2460ad2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.212483 Jan 19 16:27:40.208877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 264/510] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:39 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:40.212989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0b007bee-1c34-4e37-8e82-207f6cccad04 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:40.214019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b007bee-1c34-4e37-8e82-207f6cccad04 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:40.215751 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:40.220016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b007bee-1c34-4e37-8e82-207f6cccad04 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:40.220465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b007bee-1c34-4e37-8e82-207f6cccad04 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:40.221415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b007bee-1c34-4e37-8e82-207f6cccad04 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:40.221859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b007bee-1c34-4e37-8e82-207f6cccad04 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:40.226265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:40.227798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:40.228977 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a397db35-884f-45d3-87e3-9d21502cb6ba tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.220402 Jan 19 16:27:40.229673 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 247/511] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:40 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:40.251522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0b007bee-1c34-4e37-8e82-207f6cccad04 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042054 Jan 19 16:27:40.252112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 265/512] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:41.223376 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:41.224628 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:41.231085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:41.231528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:41.232326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:41.232761 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:41.249320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:41.250083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:41.257179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:41.257630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:41.258620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:41.258861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:41.446698 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:41.449079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:41.457726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-532d766e-0166-49f3-b7e4-15110d822d8a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.237580 Jan 19 16:27:41.459156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:41.459800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 248/513] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:41 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:41.460967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:41.462314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6d9de63e-fd10-47cd-83e9-8a5150577591 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.217375 Jan 19 16:27:41.463844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 266/514] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:41 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:41.464625 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7dc6a372-332e-4685-bffc-eca2e4c5e61f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:41.465568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7dc6a372-332e-4685-bffc-eca2e4c5e61f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:41.472248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7dc6a372-332e-4685-bffc-eca2e4c5e61f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:41.473047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7dc6a372-332e-4685-bffc-eca2e4c5e61f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:41.474014 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7dc6a372-332e-4685-bffc-eca2e4c5e61f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:41.474465 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7dc6a372-332e-4685-bffc-eca2e4c5e61f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:41.506533 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7dc6a372-332e-4685-bffc-eca2e4c5e61f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Jan 19 16:27:41.507011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 249/515] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:42.477648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:42.478286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:42.482068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:42.482677 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:42.484598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:42.485046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:42.485831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:42.486253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:42.488913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:42.489359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:42.490145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:42.490587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:42.685392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:42.693009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-80e596d5-072d-47f4-b887-a50a2c6b28dd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.219584 Jan 19 16:27:42.693307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:42.693601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 267/516] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:42 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:42.700881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85404eb5-c3db-427c-a3d0-1b8e549b0fbc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:42.701915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-85404eb5-c3db-427c-a3d0-1b8e549b0fbc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:42.702370 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:42.703895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:42.705046 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c25c2d29-fead-4301-8466-82159fdfe0e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.227607 Jan 19 16:27:42.705586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 250/517] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:42 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:42.708592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85404eb5-c3db-427c-a3d0-1b8e549b0fbc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:42.709138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85404eb5-c3db-427c-a3d0-1b8e549b0fbc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:42.709939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85404eb5-c3db-427c-a3d0-1b8e549b0fbc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:42.710379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85404eb5-c3db-427c-a3d0-1b8e549b0fbc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:42.742792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-85404eb5-c3db-427c-a3d0-1b8e549b0fbc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Jan 19 16:27:42.743290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 268/518] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:43.709372 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:43.710001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:43.716206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:43.716651 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:43.717417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:43.717849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:43.733400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:43.734133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:43.740665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:43.741675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:43.742470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:43.742936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:43.925396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:43.929980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:43.933305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-36e11070-6090-4087-b790-00fe5e269a11 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.227517 Jan 19 16:27:43.933881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 251/519] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:43 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:43.938241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:43.938376 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b4191cb1-7343-41aa-9ebe-860431cef190 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:43.939084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b4191cb1-7343-41aa-9ebe-860431cef190 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:43.939699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:43.940865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4163c63c-88db-4712-a50c-cef21d5f6752 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.211076 Jan 19 16:27:43.941679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 269/520] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:43 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:43.946019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4191cb1-7343-41aa-9ebe-860431cef190 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:43.946414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4191cb1-7343-41aa-9ebe-860431cef190 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:43.947197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4191cb1-7343-41aa-9ebe-860431cef190 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:43.947637 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4191cb1-7343-41aa-9ebe-860431cef190 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:43.977517 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b4191cb1-7343-41aa-9ebe-860431cef190 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042631 Jan 19 16:27:43.978072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 252/521] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:44.949942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:44.950561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:44.957335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:44.957789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:44.958548 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:44.959233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:44.959233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:44.960008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:44.967001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:44.967447 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:44.968461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:44.968899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:45.160644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:45.164105 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:45.168226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20f80791-4339-4cb2-b92c-adac9934df20 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.221849 Jan 19 16:27:45.168810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 270/522] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:44 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:45.173266 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:45.173472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2490153d-f163-4105-8791-7f061fc7f7e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:45.174256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2490153d-f163-4105-8791-7f061fc7f7e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:45.174767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:45.175961 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5a6bc8e3-c72d-458b-908b-dc1d1032c1e0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.221198 Jan 19 16:27:45.176679 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 253/523] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:44 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:45.180616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2490153d-f163-4105-8791-7f061fc7f7e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:45.181187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2490153d-f163-4105-8791-7f061fc7f7e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:45.182056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2490153d-f163-4105-8791-7f061fc7f7e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:45.182572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2490153d-f163-4105-8791-7f061fc7f7e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:45.215256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2490153d-f163-4105-8791-7f061fc7f7e6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Jan 19 16:27:45.215888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 271/524] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:46.185052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:46.185765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:46.192593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:46.193034 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:46.193911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:46.194336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:46.195171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:46.195903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:46.202186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:46.202644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:46.203438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:46.203907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:46.389688 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:46.396691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:46.397590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-63fb81b7-8d29-44ab-849d-0e64cb51af84 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.215637 Jan 19 16:27:46.398165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 254/525] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:46 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:46.402488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-28b830c7-28a2-41a3-9ab7-088d03a64b48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:46.403385 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-28b830c7-28a2-41a3-9ab7-088d03a64b48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:46.405601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:46.407087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:46.408327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-89e46f6b-6ea4-410a-8d99-af5120d473ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.216756 Jan 19 16:27:46.408883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 272/526] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:46 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:46.409272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28b830c7-28a2-41a3-9ab7-088d03a64b48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:46.409725 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28b830c7-28a2-41a3-9ab7-088d03a64b48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:46.410914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28b830c7-28a2-41a3-9ab7-088d03a64b48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:46.411357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28b830c7-28a2-41a3-9ab7-088d03a64b48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:46.441420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-28b830c7-28a2-41a3-9ab7-088d03a64b48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042137 Jan 19 16:27:46.441932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 255/527] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:47.416134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:47.417911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:47.425595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:47.426047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:47.426168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:47.426757 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:47.426893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:47.427262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:47.433580 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:47.434020 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:47.434806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:47.435234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:47.629151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:47.632970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:47.637939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6378ad8f-f7f7-40ec-af60-e238bdd85e30 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.226302 Jan 19 16:27:47.638557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 273/528] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:47 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:47.641454 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:47.642950 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:47.643094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3c7e1b5e-c28c-4361-959c-1841555d4672 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:47.648618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-11f5e244-54a2-4f89-a9f1-30d380e3f12e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.221922 Jan 19 16:27:47.648805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3c7e1b5e-c28c-4361-959c-1841555d4672 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:47.649256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 256/529] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:47 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:47.653665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7e1b5e-c28c-4361-959c-1841555d4672 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:47.654125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7e1b5e-c28c-4361-959c-1841555d4672 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:47.654927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7e1b5e-c28c-4361-959c-1841555d4672 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:47.655375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7e1b5e-c28c-4361-959c-1841555d4672 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:47.686353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3c7e1b5e-c28c-4361-959c-1841555d4672 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Jan 19 16:27:47.686353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 274/530] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:48.655500 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:48.656390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:48.663821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:48.665247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:48.665247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:48.665436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:48.665702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:48.665702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:48.671523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:48.672052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:48.673074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:48.673611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:48.873742 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:48.879334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:48.882008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d4d9e6b0-c917-4c19-8813-93704ed06cb1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.229475 Jan 19 16:27:48.882603 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 257/531] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:48 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:48.887545 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-81ce4f99-417c-4561-9e65-5ad17f63e041 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:48.888518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-81ce4f99-417c-4561-9e65-5ad17f63e041 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:48.894899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81ce4f99-417c-4561-9e65-5ad17f63e041 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:48.895358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81ce4f99-417c-4561-9e65-5ad17f63e041 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:48.896107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:48.896263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81ce4f99-417c-4561-9e65-5ad17f63e041 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:48.896615 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81ce4f99-417c-4561-9e65-5ad17f63e041 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:48.899358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:48.901594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-34882c8a-d099-459c-ac10-2ff8ed6ec2db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.242301 Jan 19 16:27:48.902650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 275/532] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:48 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:48.928184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-81ce4f99-417c-4561-9e65-5ad17f63e041 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Jan 19 16:27:48.928795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 258/533] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:49.898433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:49.899031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:49.905307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:49.905758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:49.906537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:49.906967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:49.930838 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:49.931449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:49.940053 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:49.940413 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:49.941203 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:49.941682 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:50.085646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:50.093353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8b5937c6-4695-485c-af2a-6a6587a8d639 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.198472 Jan 19 16:27:50.093951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 276/534] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:49 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:50.098505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-98411cc5-4997-483d-9780-42a2cc6a0f5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:50.099419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-98411cc5-4997-483d-9780-42a2cc6a0f5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:50.105921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98411cc5-4997-483d-9780-42a2cc6a0f5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:50.106389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98411cc5-4997-483d-9780-42a2cc6a0f5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:50.107191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98411cc5-4997-483d-9780-42a2cc6a0f5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:50.107617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98411cc5-4997-483d-9780-42a2cc6a0f5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:50.128307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:50.136754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:50.138258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:50.138462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-98411cc5-4997-483d-9780-42a2cc6a0f5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Jan 19 16:27:50.139038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 277/535] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:50.139414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-92926c08-6dd3-424e-b170-dd99a3f18b33 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.212897 Jan 19 16:27:50.140085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 259/536] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:49 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:51.110591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:51.111203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:51.118248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:51.118705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:51.119510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:51.120000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:51.153599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f498efa2-d251-41c6-bdc3-8e93d4b1abbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:51.154859 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f498efa2-d251-41c6-bdc3-8e93d4b1abbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:51.165746 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f498efa2-d251-41c6-bdc3-8e93d4b1abbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:51.166539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f498efa2-d251-41c6-bdc3-8e93d4b1abbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:51.167948 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f498efa2-d251-41c6-bdc3-8e93d4b1abbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:51.168629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f498efa2-d251-41c6-bdc3-8e93d4b1abbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:51.210836 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f498efa2-d251-41c6-bdc3-8e93d4b1abbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063823 Jan 19 16:27:51.212219 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 260/537] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:51.218633 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:51.219357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:51.230271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:51.231088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:51.232535 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:51.233319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:51.302161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:51.310483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5c75d7de-df58-4f33-ae63-ff48dbc422e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.203488 Jan 19 16:27:51.311079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 278/538] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:51 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:51.442140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:51.451609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:51.453272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:51.454518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b0b5bc40-931c-4ed6-86cb-3ec6c31accc8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.240908 Jan 19 16:27:51.455102 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 261/539] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:51 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:52.224313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fd7746cf-7f94-40fa-b583-7733cad1b97c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:52.225236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fd7746cf-7f94-40fa-b583-7733cad1b97c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:52.231802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7746cf-7f94-40fa-b583-7733cad1b97c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:52.232262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7746cf-7f94-40fa-b583-7733cad1b97c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:52.233056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7746cf-7f94-40fa-b583-7733cad1b97c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:52.233508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7746cf-7f94-40fa-b583-7733cad1b97c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:52.265959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fd7746cf-7f94-40fa-b583-7733cad1b97c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Jan 19 16:27:52.266557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 279/540] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:52.327848 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:52.328507 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:52.335383 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:52.335881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:52.336686 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:52.337129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:52.481441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:52.482063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:52.489520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:52.490140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:52.491597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:52.492341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:52.513440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:52.522583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-038d094a-c395-48dd-9ab5-5a785c7a08b4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.198722 Jan 19 16:27:52.523178 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 262/541] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:52 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:52.650634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:52.660719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:52.663003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:52.664245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4ef3fa41-1dda-45e0-a7dd-c3d2b702d7e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.186713 Jan 19 16:27:52.664956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 280/542] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:52 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:53.278254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2074f4cc-e0ed-4ab1-9607-dc75cab46fc7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:53.279182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2074f4cc-e0ed-4ab1-9607-dc75cab46fc7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:53.286118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2074f4cc-e0ed-4ab1-9607-dc75cab46fc7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:53.286623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2074f4cc-e0ed-4ab1-9607-dc75cab46fc7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:53.288116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2074f4cc-e0ed-4ab1-9607-dc75cab46fc7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:53.288605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2074f4cc-e0ed-4ab1-9607-dc75cab46fc7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:53.322002 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2074f4cc-e0ed-4ab1-9607-dc75cab46fc7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047659 Jan 19 16:27:53.322589 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 263/543] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:53.541122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:53.541714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:53.548854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:53.549296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:53.550086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:53.550516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:53.691281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:53.692364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:53.703230 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:53.704147 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:53.705728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:53.706516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:53.753698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:53.762288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cfbcf1bd-7c09-41a1-bee4-84e612efef85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.225408 Jan 19 16:27:53.762880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 281/544] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:53 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:53.883563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:53.892919 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:53.894443 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:53.895649 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-21b130b7-4164-4b1a-8931-3af6e44392b9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.216156 Jan 19 16:27:53.896252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 264/545] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:53 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:54.333993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0f402464-2b4e-4af3-a3ac-037c498f3d02 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:54.335078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0f402464-2b4e-4af3-a3ac-037c498f3d02 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:54.341729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f402464-2b4e-4af3-a3ac-037c498f3d02 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:54.342182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f402464-2b4e-4af3-a3ac-037c498f3d02 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:54.342993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f402464-2b4e-4af3-a3ac-037c498f3d02 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:54.343434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f402464-2b4e-4af3-a3ac-037c498f3d02 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:54.379099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0f402464-2b4e-4af3-a3ac-037c498f3d02 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048891 Jan 19 16:27:54.379727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 282/546] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:54.784361 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:54.785782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:54.797469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:54.798263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:54.799668 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:54.800491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:54.915080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:54.915759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:54.923476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:54.924148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:54.925433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:54.925999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:55.042431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:55.050393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-695b2cbc-7659-4446-8b86-82ef02f6faf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.272400 Jan 19 16:27:55.050985 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 265/547] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:54 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:55.109640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:55.118721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:55.120271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:55.121455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bcf2d569-d467-44a9-a844-061e48968936 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.210598 Jan 19 16:27:55.122027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 283/548] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:54 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:27:55.390776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b4ae2e61-0a67-4db9-a850-4833f086a4db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:55.391775 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b4ae2e61-0a67-4db9-a850-4833f086a4db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:55.398549 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4ae2e61-0a67-4db9-a850-4833f086a4db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:55.398998 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4ae2e61-0a67-4db9-a850-4833f086a4db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:55.399832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4ae2e61-0a67-4db9-a850-4833f086a4db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:55.400271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b4ae2e61-0a67-4db9-a850-4833f086a4db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:55.434807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b4ae2e61-0a67-4db9-a850-4833f086a4db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047759 Jan 19 16:27:55.435527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 266/549] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:56.066690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:56.067448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:56.075349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:56.075830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:56.076613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:56.077044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:56.141189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:56.141902 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:56.148976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:56.149417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:56.150224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:56.150652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:56.253779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:56.265119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-286fa1f4-9873-4b6b-a058-127d86cb01cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.201676 Jan 19 16:27:56.266247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 284/550] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:56 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:56.330044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:56.339555 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:56.341075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:56.342226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5c6ee321-c8e6-408e-bf8a-355476a48a75 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.204856 Jan 19 16:27:56.342787 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 267/551] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:56 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:56.447326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7af0345c-1418-42a1-8196-37d5dc302f81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:56.448291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7af0345c-1418-42a1-8196-37d5dc302f81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:56.454550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af0345c-1418-42a1-8196-37d5dc302f81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:56.455105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af0345c-1418-42a1-8196-37d5dc302f81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:56.455980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af0345c-1418-42a1-8196-37d5dc302f81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:56.456421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af0345c-1418-42a1-8196-37d5dc302f81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:56.488334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7af0345c-1418-42a1-8196-37d5dc302f81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045445 Jan 19 16:27:56.488916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 285/552] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:57.287763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:57.288795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:57.296505 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:57.296947 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:57.297750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:57.298177 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:57.365931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:57.367061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:57.378952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:57.379877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:57.381972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:57.382818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:57.501959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:57.510567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ced0f192-aee5-4bfc-9efb-07bde036f1e6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.229484 Jan 19 16:27:57.511168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 268/553] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:57 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:57.520722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-81a00d5d-6163-40db-b889-292ffa2d4326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:57.521679 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-81a00d5d-6163-40db-b889-292ffa2d4326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:57.528140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81a00d5d-6163-40db-b889-292ffa2d4326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:57.528588 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81a00d5d-6163-40db-b889-292ffa2d4326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:57.529376 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81a00d5d-6163-40db-b889-292ffa2d4326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:57.529808 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-81a00d5d-6163-40db-b889-292ffa2d4326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:57.561804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-81a00d5d-6163-40db-b889-292ffa2d4326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 Jan 19 16:27:57.562305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 269/554] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:57.576393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:57.585980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:57.587789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:57.588984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a53baba7-8dec-4ddd-8aae-1d412f9ed526 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.232042 Jan 19 16:27:57.589560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 286/555] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:57 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:58.527733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:58.528609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:58.535789 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:58.536244 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:58.537551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:58.537986 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:58.573408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7d80cced-08c6-4bd5-bbb2-f0a2b9831aa8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:58.574470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7d80cced-08c6-4bd5-bbb2-f0a2b9831aa8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:58.581422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d80cced-08c6-4bd5-bbb2-f0a2b9831aa8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:58.581879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d80cced-08c6-4bd5-bbb2-f0a2b9831aa8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:58.582696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d80cced-08c6-4bd5-bbb2-f0a2b9831aa8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:58.583148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d80cced-08c6-4bd5-bbb2-f0a2b9831aa8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:58.633677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7d80cced-08c6-4bd5-bbb2-f0a2b9831aa8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063587 Jan 19 16:27:58.635325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 287/556] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:27:58.642804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:58.643735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:58.653586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:58.654351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:58.655718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:58.656477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:58.758856 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:58.771652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f40861a6-332b-4b24-82f0-8807bf8ead05 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.247364 Jan 19 16:27:58.772733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 270/557] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:58 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:27:58.837727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:58.852590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:58.855519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:58.857519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-853ced4f-1eaf-49bc-b43c-2f8095d37b78 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.220937 Jan 19 16:27:58.858481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 288/558] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:58 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:27:59.649397 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3c9e1d95-1b51-4d09-b26c-477c53c769f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:59.650329 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3c9e1d95-1b51-4d09-b26c-477c53c769f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:59.657186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c9e1d95-1b51-4d09-b26c-477c53c769f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:59.657632 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c9e1d95-1b51-4d09-b26c-477c53c769f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:59.658417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c9e1d95-1b51-4d09-b26c-477c53c769f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:59.658850 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c9e1d95-1b51-4d09-b26c-477c53c769f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:59.691421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3c9e1d95-1b51-4d09-b26c-477c53c769f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Jan 19 16:27:59.692052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 271/559] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:27:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:27:59.789171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:59.789786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:59.796404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:59.796864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:59.797666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:59.798103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:59.885256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:27:59.885983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:27:59.893158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:59.893735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:59.894531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:27:59.894962 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:27:59.955414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:27:59.963197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-97ba2ba4-f9b5-49a4-bc21-4de3923b920c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.177953 Jan 19 16:27:59.964026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 289/560] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:27:59 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:28:00.051434 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:00.061658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:00.063350 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:00.064664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-17734cc0-fab6-4303-b643-5832a9823ad5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.184575 Jan 19 16:28:00.065378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 272/561] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:27:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:00.217373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-119bfe51-0799-40db-a8ea-18945bc6c34a req-c710da0e-9c28-469e-a1aa-436ff20062a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805b0677-e780-415d-8ce6-ca4ec1a0817a", "name": "network-vif-plugged", "status": "completed", "tag": "94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:28:00.219453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:28:00.219453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:28:00.227888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-119bfe51-0799-40db-a8ea-18945bc6c34a req-c710da0e-9c28-469e-a1aa-436ff20062a1 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:00.228371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-119bfe51-0799-40db-a8ea-18945bc6c34a req-c710da0e-9c28-469e-a1aa-436ff20062a1 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:00.241220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-119bfe51-0799-40db-a8ea-18945bc6c34a req-c710da0e-9c28-469e-a1aa-436ff20062a1 service nova] Creating event network-vif-plugged:94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87 for instance 805b0677-e780-415d-8ce6-ca4ec1a0817a on hv-cinder-78447 Jan 19 16:28:00.246705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-119bfe51-0799-40db-a8ea-18945bc6c34a req-c710da0e-9c28-469e-a1aa-436ff20062a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Jan 19 16:28:00.247497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 290/562] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:00.703275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a73b84a1-2d99-47eb-a65b-ec195701c431 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:00.704283 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a73b84a1-2d99-47eb-a65b-ec195701c431 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:00.711653 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73b84a1-2d99-47eb-a65b-ec195701c431 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:00.712220 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73b84a1-2d99-47eb-a65b-ec195701c431 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:00.713035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73b84a1-2d99-47eb-a65b-ec195701c431 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:00.713469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73b84a1-2d99-47eb-a65b-ec195701c431 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:00.747337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a73b84a1-2d99-47eb-a65b-ec195701c431 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047819 Jan 19 16:28:00.747978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 273/563] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:00.981116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:00.981814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:00.988470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:00.988917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:00.989712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:00.990159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:01.084875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:01.085492 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:01.094155 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:01.094602 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:01.095442 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:01.095913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:01.148962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:01.161133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8c8d5b7a-14e7-44e6-aa37-6b1405ff8598 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.184374 Jan 19 16:28:01.161725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 291/564] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:28:00 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:28:01.250914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:01.260759 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:01.262290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:01.263478 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-be939497-92b4-4766-8ea9-4b5c104ca1d7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.182962 Jan 19 16:28:01.264085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 274/565] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:01.345625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:28:01.345873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:28:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:28:01.760320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eb38b8e7-e4c4-4bc8-9d4a-f52856c10bad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:01.761329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eb38b8e7-e4c4-4bc8-9d4a-f52856c10bad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:01.767717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb38b8e7-e4c4-4bc8-9d4a-f52856c10bad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:01.768294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb38b8e7-e4c4-4bc8-9d4a-f52856c10bad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:01.769166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb38b8e7-e4c4-4bc8-9d4a-f52856c10bad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:01.769655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb38b8e7-e4c4-4bc8-9d4a-f52856c10bad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:01.804489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eb38b8e7-e4c4-4bc8-9d4a-f52856c10bad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047905 Jan 19 16:28:01.805095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 292/566] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:02.184440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:02.185409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:02.196814 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:02.197470 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:02.198435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:02.198941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:02.285600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:02.286215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:02.296056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:02.296510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:02.297732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:02.298755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:02.363116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:02.378390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-acb77301-969d-4b3c-b524-638105184a16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.200050 Jan 19 16:28:02.379452 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 275/567] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:28:02 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:28:02.470404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:02.486316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:02.489575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:02.491921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2c312295-1a87-4e5a-8d3d-dfc5cfcd402f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.212462 Jan 19 16:28:02.492708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 293/568] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:02 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:02.817022 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ebe2289d-7330-4939-905f-1e5232eac428 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:02.817862 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ebe2289d-7330-4939-905f-1e5232eac428 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:02.824993 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebe2289d-7330-4939-905f-1e5232eac428 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:02.825445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebe2289d-7330-4939-905f-1e5232eac428 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:02.826293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebe2289d-7330-4939-905f-1e5232eac428 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:02.826741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebe2289d-7330-4939-905f-1e5232eac428 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:02.858987 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ebe2289d-7330-4939-905f-1e5232eac428 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 Jan 19 16:28:02.859585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 276/569] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:03.396602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:03.397267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:03.403984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:03.404436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:03.405233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:03.405672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:03.514547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:03.515701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:03.527909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:03.528630 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:03.530042 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:03.530866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:03.553164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:03.561746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8f8dccc9-6568-45cb-ac09-51f5764bd00a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.169336 Jan 19 16:28:03.562689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 294/570] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:28:03 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:28:03.687722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:03.701322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:03.702863 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:03.704093 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8cb726ea-963e-447c-8bcb-9e1e6740ef26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.196471 Jan 19 16:28:03.704681 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 277/571] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:03 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:03.870581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f6809cd8-7605-451b-bd03-bb0b7e95a841 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:03.871500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f6809cd8-7605-451b-bd03-bb0b7e95a841 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:03.877503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6809cd8-7605-451b-bd03-bb0b7e95a841 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:03.877961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6809cd8-7605-451b-bd03-bb0b7e95a841 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:03.878788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6809cd8-7605-451b-bd03-bb0b7e95a841 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:03.879233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6809cd8-7605-451b-bd03-bb0b7e95a841 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:03.911179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f6809cd8-7605-451b-bd03-bb0b7e95a841 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Jan 19 16:28:03.911784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 295/572] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:04.578996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:04.579866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:04.587022 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:04.587507 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:04.588359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:04.588795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:04.726567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:04.727650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:04.738641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:04.739441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:04.741663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:04.742469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:04.751131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:04.759822 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-73a85238-1e20-41b0-8d1c-d5f038bb5077 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.184358 Jan 19 16:28:04.760657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 278/573] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:28:04 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:28:04.922624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a46ecc8d-da6c-4399-a048-1d9ffbacfde9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:04.923735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a46ecc8d-da6c-4399-a048-1d9ffbacfde9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:04.931009 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a46ecc8d-da6c-4399-a048-1d9ffbacfde9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:04.931713 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a46ecc8d-da6c-4399-a048-1d9ffbacfde9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:04.932528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a46ecc8d-da6c-4399-a048-1d9ffbacfde9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:04.932963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a46ecc8d-da6c-4399-a048-1d9ffbacfde9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:04.933091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:04.942368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:04.944039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:04.945342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c3b1bb4e-6b5b-4910-81dd-8a1834d063da tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.226225 Jan 19 16:28:04.945949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 296/574] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:04 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:04.984265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a46ecc8d-da6c-4399-a048-1d9ffbacfde9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065676 Jan 19 16:28:04.984849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 279/575] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:05.777376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:05.778033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:05.785645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:05.786085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:05.786904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:05.787314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:05.949286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:05.962673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bb7b1cdd-1fb0-44a7-9347-4f76dfe52b2d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1265 microversion: 2.1 time: 0.188745 Jan 19 16:28:05.967821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 297/576] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:28:05 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:28:05.968143 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:05.968143 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:05.972435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:05.972877 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:05.973678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:05.974135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:05.998898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6dded310-b1ca-4c85-a9f3-c7414b241b7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:06.000100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6dded310-b1ca-4c85-a9f3-c7414b241b7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:06.007743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dded310-b1ca-4c85-a9f3-c7414b241b7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:06.008381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dded310-b1ca-4c85-a9f3-c7414b241b7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:06.009547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dded310-b1ca-4c85-a9f3-c7414b241b7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:06.010161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dded310-b1ca-4c85-a9f3-c7414b241b7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:06.044329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6dded310-b1ca-4c85-a9f3-c7414b241b7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049731 Jan 19 16:28:06.045279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 298/577] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:06.145247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:06.154864 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:06.156421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:06.157632 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4bbc6cd7-bcc4-4415-a04a-254728658d29 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.197155 Jan 19 16:28:06.158206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 280/578] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:05 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:06.981565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:06.982729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:06.989428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:06.989870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:06.990665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:06.991099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:07.056573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4dd02092-4564-46b2-82f9-d4c2cddad5cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:07.057525 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4dd02092-4564-46b2-82f9-d4c2cddad5cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:07.065227 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4dd02092-4564-46b2-82f9-d4c2cddad5cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:07.065678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4dd02092-4564-46b2-82f9-d4c2cddad5cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:07.066520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4dd02092-4564-46b2-82f9-d4c2cddad5cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:07.066961 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4dd02092-4564-46b2-82f9-d4c2cddad5cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:07.113297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4dd02092-4564-46b2-82f9-d4c2cddad5cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060267 Jan 19 16:28:07.114116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 281/579] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:07.157800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:07.166580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-43b8a2c3-c48c-46aa-ac7b-bf9b56436119 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1452 microversion: 2.1 time: 0.188712 Jan 19 16:28:07.167178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 299/580] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:28:06 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:28:07.184214 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:07.184837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:07.186763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:07.187552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:07.195663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:07.195940 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:07.196360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:07.196515 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:07.197326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:07.197951 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:07.198085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:07.198738 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:07.422872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:07.426355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:07.434419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-300c2838-603d-483f-866a-864c3ff0f27b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1452 microversion: 2.1 time: 0.253551 Jan 19 16:28:07.435299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 282/581] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:28:07 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:28:07.441957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:07.444274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:07.445678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a34fff69-46f4-455d-a479-117251d08d91 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.263231 Jan 19 16:28:07.446367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 300/582] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:08.127785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1d6baf77-0499-4392-b85c-076c766c1a43 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:08.129297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1d6baf77-0499-4392-b85c-076c766c1a43 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:08.138095 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d6baf77-0499-4392-b85c-076c766c1a43 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:08.138814 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d6baf77-0499-4392-b85c-076c766c1a43 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:08.139964 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d6baf77-0499-4392-b85c-076c766c1a43 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:08.140590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d6baf77-0499-4392-b85c-076c766c1a43 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:08.201797 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1d6baf77-0499-4392-b85c-076c766c1a43 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077906 Jan 19 16:28:08.202857 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 283/583] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:08.464989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:08.465996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:08.474695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:08.475405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:08.476521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:08.477150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:08.662750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:08.672244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:08.673877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:08.675129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c02e6e18-682f-4027-aa4e-575f8bf07d71 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.214832 Jan 19 16:28:08.675731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 301/584] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:08 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:09.217293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cb86b610-be27-4285-8b99-7cde174f4b35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:09.218765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cb86b610-be27-4285-8b99-7cde174f4b35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:09.226891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cb86b610-be27-4285-8b99-7cde174f4b35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:09.227412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cb86b610-be27-4285-8b99-7cde174f4b35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:09.228718 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cb86b610-be27-4285-8b99-7cde174f4b35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:09.229321 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cb86b610-be27-4285-8b99-7cde174f4b35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:09.264741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cb86b610-be27-4285-8b99-7cde174f4b35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052829 Jan 19 16:28:09.265653 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 284/585] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:09.700766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:09.701740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:09.715637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:09.717359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:09.718833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:09.719641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:09.768307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-06802e03-86fa-4c7a-934a-6504b39c06ba req-4b00141f-391e-4d0c-8d84-0cccfc2dfad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805b0677-e780-415d-8ce6-ca4ec1a0817a", "tag": "94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:28:09.768307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:28:09.768307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:28:09.780085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-06802e03-86fa-4c7a-934a-6504b39c06ba req-4b00141f-391e-4d0c-8d84-0cccfc2dfad7 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:09.781370 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-06802e03-86fa-4c7a-934a-6504b39c06ba req-4b00141f-391e-4d0c-8d84-0cccfc2dfad7 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:09.806574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-06802e03-86fa-4c7a-934a-6504b39c06ba req-4b00141f-391e-4d0c-8d84-0cccfc2dfad7 service nova] Creating event network-changed:94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87 for instance 805b0677-e780-415d-8ce6-ca4ec1a0817a on hv-cinder-78447 Jan 19 16:28:09.813063 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-06802e03-86fa-4c7a-934a-6504b39c06ba req-4b00141f-391e-4d0c-8d84-0cccfc2dfad7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054353 Jan 19 16:28:09.813791 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 285/586] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:10.002471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:10.018116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:10.020232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:10.021561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dac3583f-ed7f-4072-8bfe-022b3abe1a87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.328692 Jan 19 16:28:10.022323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 302/587] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:09 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:10.279916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fd00f9a4-2b3a-41ee-af2a-8dedc61972bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:10.281887 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fd00f9a4-2b3a-41ee-af2a-8dedc61972bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:10.290924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fd00f9a4-2b3a-41ee-af2a-8dedc61972bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:10.291693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fd00f9a4-2b3a-41ee-af2a-8dedc61972bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:10.292824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fd00f9a4-2b3a-41ee-af2a-8dedc61972bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:10.293445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fd00f9a4-2b3a-41ee-af2a-8dedc61972bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:10.326159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fd00f9a4-2b3a-41ee-af2a-8dedc61972bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050905 Jan 19 16:28:10.326724 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 286/588] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:11.040563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:11.041181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:11.047651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:11.048139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:11.048934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:11.049570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:11.186179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:11.194951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:11.196536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:11.197809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-31c50581-79f4-4879-8a8d-4238cadb623e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161519 Jan 19 16:28:11.198330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 303/589] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:11 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:11.342624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9ae55c04-cb7a-42db-8c38-8674c0b1bc47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:11.343462 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9ae55c04-cb7a-42db-8c38-8674c0b1bc47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:11.350000 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9ae55c04-cb7a-42db-8c38-8674c0b1bc47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:11.350453 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9ae55c04-cb7a-42db-8c38-8674c0b1bc47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:11.351242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9ae55c04-cb7a-42db-8c38-8674c0b1bc47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:11.351706 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9ae55c04-cb7a-42db-8c38-8674c0b1bc47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:11.383284 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9ae55c04-cb7a-42db-8c38-8674c0b1bc47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Jan 19 16:28:11.383920 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 287/590] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:12.216623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:12.217230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:12.224674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:12.225157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:12.226091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:12.226527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:12.370651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:12.379349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:12.381233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:12.382087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a49ce7cf-5b4f-4730-8887-de1d1470c26e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.169214 Jan 19 16:28:12.382674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 304/591] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:12.394603 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e35c6c6f-d7be-40e9-89f0-08da0f43c794 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:12.395509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e35c6c6f-d7be-40e9-89f0-08da0f43c794 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:12.401875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e35c6c6f-d7be-40e9-89f0-08da0f43c794 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:12.402330 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e35c6c6f-d7be-40e9-89f0-08da0f43c794 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:12.403159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e35c6c6f-d7be-40e9-89f0-08da0f43c794 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:12.403606 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e35c6c6f-d7be-40e9-89f0-08da0f43c794 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:12.435734 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e35c6c6f-d7be-40e9-89f0-08da0f43c794 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Jan 19 16:28:12.436340 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 288/592] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:13.400232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:13.400838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:13.407242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:13.407721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:13.408516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:13.408951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:13.451873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3619d2bf-0c91-4615-b2b7-9a1ceb6df029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:13.453755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3619d2bf-0c91-4615-b2b7-9a1ceb6df029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:13.464445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3619d2bf-0c91-4615-b2b7-9a1ceb6df029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:13.464890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3619d2bf-0c91-4615-b2b7-9a1ceb6df029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:13.465692 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3619d2bf-0c91-4615-b2b7-9a1ceb6df029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:13.466136 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3619d2bf-0c91-4615-b2b7-9a1ceb6df029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:13.496353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3619d2bf-0c91-4615-b2b7-9a1ceb6df029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050318 Jan 19 16:28:13.496930 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 289/593] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:13.543958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:13.553174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:13.554678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:13.555918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d31b6c62-dfdf-4c01-8abd-a0c715cfaf6e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159367 Jan 19 16:28:13.556491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 305/594] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:14.511258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7e00f0ef-c89b-47e1-b6f6-c872f0512e64 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:14.512921 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7e00f0ef-c89b-47e1-b6f6-c872f0512e64 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:14.519430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e00f0ef-c89b-47e1-b6f6-c872f0512e64 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:14.519959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e00f0ef-c89b-47e1-b6f6-c872f0512e64 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:14.520755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e00f0ef-c89b-47e1-b6f6-c872f0512e64 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:14.521195 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e00f0ef-c89b-47e1-b6f6-c872f0512e64 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:14.553995 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7e00f0ef-c89b-47e1-b6f6-c872f0512e64 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046598 Jan 19 16:28:14.554587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 290/595] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:14.575696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:14.576352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:14.582844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:14.583555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:14.584978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:14.585734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:14.739376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:14.748780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:14.750268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:14.751411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c7103b57-dcac-44bb-aacf-cfc25407310b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.179590 Jan 19 16:28:14.752011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 306/596] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:14 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:15.565710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ec193cc6-7a19-4056-a93c-cd2b3774b038 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:15.566632 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ec193cc6-7a19-4056-a93c-cd2b3774b038 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:15.577081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec193cc6-7a19-4056-a93c-cd2b3774b038 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:15.577536 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec193cc6-7a19-4056-a93c-cd2b3774b038 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:15.578339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec193cc6-7a19-4056-a93c-cd2b3774b038 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:15.578783 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ec193cc6-7a19-4056-a93c-cd2b3774b038 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:15.615913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ec193cc6-7a19-4056-a93c-cd2b3774b038 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053864 Jan 19 16:28:15.616529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 291/597] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:15.769772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:15.770391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:15.776922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:15.777374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:15.778171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:15.778610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:15.937350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:15.947420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:15.949158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:15.950345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-43125e72-3257-4a03-af0e-efe9c0d5bcae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.184295 Jan 19 16:28:15.951244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 307/598] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:15 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:16.627839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a557d842-cafa-456a-96bf-dced2c8dd8c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:16.628755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a557d842-cafa-456a-96bf-dced2c8dd8c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:16.634788 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a557d842-cafa-456a-96bf-dced2c8dd8c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:16.635244 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a557d842-cafa-456a-96bf-dced2c8dd8c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:16.636072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a557d842-cafa-456a-96bf-dced2c8dd8c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:16.636508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a557d842-cafa-456a-96bf-dced2c8dd8c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:16.667609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a557d842-cafa-456a-96bf-dced2c8dd8c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Jan 19 16:28:16.668230 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 292/599] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:16.981098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:16.982014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:16.988675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:16.989124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:16.989966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:16.990402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:17.138456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:17.147939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:17.149438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:17.150596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f17595f5-eaba-410a-aced-326ee6fa73fd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.173976 Jan 19 16:28:17.151164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 308/600] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:17.678861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5b299c32-c1e7-4fd8-9abe-935a10dead6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:17.679804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5b299c32-c1e7-4fd8-9abe-935a10dead6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:17.686276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b299c32-c1e7-4fd8-9abe-935a10dead6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:17.686731 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b299c32-c1e7-4fd8-9abe-935a10dead6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:17.687522 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b299c32-c1e7-4fd8-9abe-935a10dead6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:17.687951 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b299c32-c1e7-4fd8-9abe-935a10dead6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:17.717571 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5b299c32-c1e7-4fd8-9abe-935a10dead6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042946 Jan 19 16:28:17.718143 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 293/601] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:18.169947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:18.170554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:18.177456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:18.177921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:18.178700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:18.179139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:18.309911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:18.318202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:18.319712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:18.320860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d2d24cf5-3ca6-45fd-93b3-0eee878ebc1e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154588 Jan 19 16:28:18.321424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 309/602] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:18 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:18.728970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2c51c4e8-e217-4a52-aff5-1671909a8d14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:18.729887 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2c51c4e8-e217-4a52-aff5-1671909a8d14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:18.736312 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2c51c4e8-e217-4a52-aff5-1671909a8d14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:18.736765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2c51c4e8-e217-4a52-aff5-1671909a8d14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:18.737545 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2c51c4e8-e217-4a52-aff5-1671909a8d14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:18.737989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2c51c4e8-e217-4a52-aff5-1671909a8d14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:18.766558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2c51c4e8-e217-4a52-aff5-1671909a8d14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Jan 19 16:28:18.767122 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 294/603] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:19.339018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:19.339622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:19.346087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:19.346541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:19.347318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:19.347790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:19.477049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:19.485214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:19.486699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:19.487858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8f3da590-1c79-46bb-9380-3e32d7b65699 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152616 Jan 19 16:28:19.488416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 310/604] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:19.778351 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fefc59ad-e0ad-4460-83cd-ccbbfe37a211 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:19.779296 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fefc59ad-e0ad-4460-83cd-ccbbfe37a211 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:19.786060 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fefc59ad-e0ad-4460-83cd-ccbbfe37a211 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:19.786548 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fefc59ad-e0ad-4460-83cd-ccbbfe37a211 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:19.787355 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fefc59ad-e0ad-4460-83cd-ccbbfe37a211 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:19.787867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fefc59ad-e0ad-4460-83cd-ccbbfe37a211 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:19.822202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fefc59ad-e0ad-4460-83cd-ccbbfe37a211 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047560 Jan 19 16:28:19.823123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 295/605] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:20.505945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:20.506555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:20.512460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:20.512915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:20.513690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:20.514132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:20.643053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:20.651803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:20.653277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:20.654391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0d7c784a-90a7-4cab-bbbb-9af08932bd6b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152412 Jan 19 16:28:20.654945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 311/606] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:20 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:20.833996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-72f8d41d-7c2f-46a5-9f8d-e9a26bc67fc6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:20.835433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-72f8d41d-7c2f-46a5-9f8d-e9a26bc67fc6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:20.841756 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72f8d41d-7c2f-46a5-9f8d-e9a26bc67fc6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:20.842211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72f8d41d-7c2f-46a5-9f8d-e9a26bc67fc6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:20.842993 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72f8d41d-7c2f-46a5-9f8d-e9a26bc67fc6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:20.843436 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72f8d41d-7c2f-46a5-9f8d-e9a26bc67fc6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:20.872175 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-72f8d41d-7c2f-46a5-9f8d-e9a26bc67fc6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Jan 19 16:28:20.872791 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 296/607] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:21.673514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:21.674149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:21.681364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:21.681821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:21.682648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:21.683092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:21.818475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:21.826584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:21.828099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:21.829228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-da9a473f-5b00-4634-9565-23f195d45c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159597 Jan 19 16:28:21.829782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 312/608] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:21 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:21.884314 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a031d458-40eb-4132-8579-74e6f0d0773a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:21.885217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a031d458-40eb-4132-8579-74e6f0d0773a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:21.891644 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a031d458-40eb-4132-8579-74e6f0d0773a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:21.892117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a031d458-40eb-4132-8579-74e6f0d0773a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:21.892948 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a031d458-40eb-4132-8579-74e6f0d0773a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:21.893378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a031d458-40eb-4132-8579-74e6f0d0773a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:21.922662 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a031d458-40eb-4132-8579-74e6f0d0773a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042957 Jan 19 16:28:21.923209 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 297/609] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:22.847911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:22.848521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:22.855396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:22.855895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:22.856677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:22.857119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:22.933381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-62bb56f0-cca4-4237-9f46-dbbffd8e6550 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:22.934756 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-62bb56f0-cca4-4237-9f46-dbbffd8e6550 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:22.941008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62bb56f0-cca4-4237-9f46-dbbffd8e6550 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:22.941458 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62bb56f0-cca4-4237-9f46-dbbffd8e6550 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:22.942244 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62bb56f0-cca4-4237-9f46-dbbffd8e6550 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:22.942679 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-62bb56f0-cca4-4237-9f46-dbbffd8e6550 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:22.973082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-62bb56f0-cca4-4237-9f46-dbbffd8e6550 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Jan 19 16:28:22.974037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 298/610] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:22.988850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:22.997071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:22.998580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:22.999972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-71e0a17c-7b38-4345-bb60-0b1bc751bb0b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155653 Jan 19 16:28:23.000325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 313/611] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:22 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:23.079449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:23.079967 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:23.086690 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:23.087142 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:23.087948 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:23.088397 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:23.984336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a4d98a31-bcbd-4313-a1df-ce77a8090564 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:23.985633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a4d98a31-bcbd-4313-a1df-ce77a8090564 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:23.992604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d98a31-bcbd-4313-a1df-ce77a8090564 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:23.993059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d98a31-bcbd-4313-a1df-ce77a8090564 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:23.993841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d98a31-bcbd-4313-a1df-ce77a8090564 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:23.994290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d98a31-bcbd-4313-a1df-ce77a8090564 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:24.023455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a4d98a31-bcbd-4313-a1df-ce77a8090564 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Jan 19 16:28:24.024049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 314/612] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:24.030325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:24.030923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:24.036844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:24.037340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:24.038644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:24.039083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:24.165757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:24.173979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:24.175475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:24.176652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0273a6dd-909a-4c9b-b45c-7b4aa2fea1c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151700 Jan 19 16:28:24.177211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 315/613] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:24 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:25.035108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5d3a2b46-0ccc-4847-8d90-785a285ef2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:25.036048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5d3a2b46-0ccc-4847-8d90-785a285ef2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:25.042303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d3a2b46-0ccc-4847-8d90-785a285ef2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:25.042759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d3a2b46-0ccc-4847-8d90-785a285ef2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:25.043532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d3a2b46-0ccc-4847-8d90-785a285ef2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:25.044003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d3a2b46-0ccc-4847-8d90-785a285ef2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:25.073073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5d3a2b46-0ccc-4847-8d90-785a285ef2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041938 Jan 19 16:28:25.073630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 316/614] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:25.194685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:25.195334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:25.201901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:25.202354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:25.203132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:25.203564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:25.330573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:25.338695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:25.340213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:25.341380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9542ca4-7219-4d0e-b4b2-43189868d757 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150591 Jan 19 16:28:25.341945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 317/615] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:25 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:26.084716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a8f7f1a3-64c5-468c-baf1-c37049add02b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:26.085656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a8f7f1a3-64c5-468c-baf1-c37049add02b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:26.092127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8f7f1a3-64c5-468c-baf1-c37049add02b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:26.092635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8f7f1a3-64c5-468c-baf1-c37049add02b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:26.093429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8f7f1a3-64c5-468c-baf1-c37049add02b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:26.093808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8f7f1a3-64c5-468c-baf1-c37049add02b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:26.123417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a8f7f1a3-64c5-468c-baf1-c37049add02b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043006 Jan 19 16:28:26.124039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 318/616] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:26.360950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:26.361507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:26.368139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:26.368594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:26.369382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:26.369828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:26.507015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:26.515571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:26.517099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:26.518269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3837b84-de8b-4a4e-9fb3-7b4ece513b02 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161541 Jan 19 16:28:26.518840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 319/617] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:26 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:27.135224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20ba07ef-3130-447e-95be-a154a2323773 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:27.136162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20ba07ef-3130-447e-95be-a154a2323773 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:27.142732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20ba07ef-3130-447e-95be-a154a2323773 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:27.143175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20ba07ef-3130-447e-95be-a154a2323773 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:27.144008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20ba07ef-3130-447e-95be-a154a2323773 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:27.144440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20ba07ef-3130-447e-95be-a154a2323773 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:27.180427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20ba07ef-3130-447e-95be-a154a2323773 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049037 Jan 19 16:28:27.181000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 320/618] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:27.541186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:27.541798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:27.548008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:27.548466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:27.549416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:27.549856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:27.688427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:27.699611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:27.701252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:27.702888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-36ca9a6b-365b-45be-8bb2-6f4b0c99f5fa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165114 Jan 19 16:28:27.703845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 321/619] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:27 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:28.191945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3e0e6c10-7256-4946-99b9-eb53f465302b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:28.192852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3e0e6c10-7256-4946-99b9-eb53f465302b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:28.201009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e0e6c10-7256-4946-99b9-eb53f465302b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:28.202046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e0e6c10-7256-4946-99b9-eb53f465302b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:28.202949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e0e6c10-7256-4946-99b9-eb53f465302b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:28.203566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e0e6c10-7256-4946-99b9-eb53f465302b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:28.232941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3e0e6c10-7256-4946-99b9-eb53f465302b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Jan 19 16:28:28.233499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 322/620] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:28.721914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:28.722545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:28.728540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:28.728992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:28.729776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:28.730215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:29.062769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:29.071109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:29.072663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:29.073809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ece14ac9-d580-4d2d-b913-53574c63c519 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.355636 Jan 19 16:28:29.074366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 323/621] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:28 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:29.244782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-90e42b18-996d-4ae6-b5d5-e79b8fec933b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:29.245698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90e42b18-996d-4ae6-b5d5-e79b8fec933b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:29.252049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90e42b18-996d-4ae6-b5d5-e79b8fec933b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:29.252586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90e42b18-996d-4ae6-b5d5-e79b8fec933b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:29.253487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90e42b18-996d-4ae6-b5d5-e79b8fec933b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:29.253911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90e42b18-996d-4ae6-b5d5-e79b8fec933b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:29.283316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-90e42b18-996d-4ae6-b5d5-e79b8fec933b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Jan 19 16:28:29.283908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 324/622] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:30.091999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:30.092606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:30.098600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:30.099053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:30.099876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:30.100317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:30.230996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:30.239239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:30.241287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:30.242430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fb3cdb38-10bd-4b05-b567-52463f70be5e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154249 Jan 19 16:28:30.242983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 325/623] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:30 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:30.295478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5db2885d-5aeb-4f35-bce5-9dd67e0b0ec3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:30.296452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5db2885d-5aeb-4f35-bce5-9dd67e0b0ec3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:30.303334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db2885d-5aeb-4f35-bce5-9dd67e0b0ec3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:30.303806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db2885d-5aeb-4f35-bce5-9dd67e0b0ec3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:30.304600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db2885d-5aeb-4f35-bce5-9dd67e0b0ec3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:30.305028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5db2885d-5aeb-4f35-bce5-9dd67e0b0ec3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:30.336714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5db2885d-5aeb-4f35-bce5-9dd67e0b0ec3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Jan 19 16:28:30.337298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 326/624] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:28:31.260970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:31.262425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:31.267403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:31.267878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:31.268654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:31.269086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:31.399452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:31.407569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:31.409078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:31.410466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1f74b3e9-27b2-4bfc-a458-c025a7182130 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153204 Jan 19 16:28:31.411020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 327/625] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:31 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:31.415251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bd43543a-5561-472a-b0ea-121181be2cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:31.416172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bd43543a-5561-472a-b0ea-121181be2cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:31.421808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd43543a-5561-472a-b0ea-121181be2cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:31.422255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd43543a-5561-472a-b0ea-121181be2cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:31.423034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd43543a-5561-472a-b0ea-121181be2cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:31.423475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd43543a-5561-472a-b0ea-121181be2cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:31.453256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bd43543a-5561-472a-b0ea-121181be2cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041206 Jan 19 16:28:31.453824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 328/626] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:32.430044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:32.430783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:32.437197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:32.437644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:32.438430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:32.438870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:32.566056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:32.574967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:32.576502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:32.577644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ab0c7883-f301-48da-83b8-855d051f593e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151893 Jan 19 16:28:32.578206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 329/627] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:32 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:32.582441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d56d2f57-7cca-4803-b87d-b3d63888dd76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:32.583339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d56d2f57-7cca-4803-b87d-b3d63888dd76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:32.588918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d56d2f57-7cca-4803-b87d-b3d63888dd76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:32.589370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d56d2f57-7cca-4803-b87d-b3d63888dd76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:32.590161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d56d2f57-7cca-4803-b87d-b3d63888dd76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:32.590599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d56d2f57-7cca-4803-b87d-b3d63888dd76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:32.619584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d56d2f57-7cca-4803-b87d-b3d63888dd76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040381 Jan 19 16:28:32.620178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 330/628] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:33.595985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:33.596661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:33.603656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:33.604147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:33.604950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:33.605392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:33.744641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:33.753233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:33.754715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:33.755904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ba2cdf00-d8c6-4128-9dd9-dcd11c50e050 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163831 Jan 19 16:28:33.756510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 331/629] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:33 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:33.760842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8bd7cb98-a4ec-4d56-a14f-283988ff7a1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:33.761731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8bd7cb98-a4ec-4d56-a14f-283988ff7a1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:33.767904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd7cb98-a4ec-4d56-a14f-283988ff7a1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:33.768365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd7cb98-a4ec-4d56-a14f-283988ff7a1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:33.769156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd7cb98-a4ec-4d56-a14f-283988ff7a1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:33.769598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd7cb98-a4ec-4d56-a14f-283988ff7a1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:33.799837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8bd7cb98-a4ec-4d56-a14f-283988ff7a1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042260 Jan 19 16:28:33.800414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 332/630] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:34.774518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:34.775293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:34.782180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:34.782619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:34.783394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:34.783858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:34.920414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:34.929495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:34.930971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:34.932161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ebdd0d7a-83bd-49f0-89e2-012419b1ea8b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161580 Jan 19 16:28:34.932713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 333/631] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:34 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:34.937446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eae0f782-90ee-4c2c-8a6e-9ac3f4716552 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:34.938245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eae0f782-90ee-4c2c-8a6e-9ac3f4716552 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:34.944390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eae0f782-90ee-4c2c-8a6e-9ac3f4716552 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:34.944837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eae0f782-90ee-4c2c-8a6e-9ac3f4716552 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:34.945620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eae0f782-90ee-4c2c-8a6e-9ac3f4716552 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:34.946050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eae0f782-90ee-4c2c-8a6e-9ac3f4716552 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:34.977089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eae0f782-90ee-4c2c-8a6e-9ac3f4716552 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043265 Jan 19 16:28:34.977815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 334/632] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:35.951122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:35.951867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:35.959170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:35.959623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:35.961036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:35.961475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:36.088999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:36.097286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:36.098787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:36.099967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6e46060a-91c5-48cd-a0de-591e71a3ae87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152833 Jan 19 16:28:36.100534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 335/633] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:35 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:36.104984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5d4d8405-8e5b-44dd-bc82-7b13ad84064f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:36.105890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5d4d8405-8e5b-44dd-bc82-7b13ad84064f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:36.111930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d4d8405-8e5b-44dd-bc82-7b13ad84064f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:36.112384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d4d8405-8e5b-44dd-bc82-7b13ad84064f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:36.113164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d4d8405-8e5b-44dd-bc82-7b13ad84064f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:36.113633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d4d8405-8e5b-44dd-bc82-7b13ad84064f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:36.142830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5d4d8405-8e5b-44dd-bc82-7b13ad84064f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Jan 19 16:28:36.143378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 336/634] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:37.117827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:37.118521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:37.124921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:37.125389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:37.126205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:37.126641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:37.271015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:37.279995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:37.281475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:37.282611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eb4e26ff-1bd8-446f-895a-81b513c333fc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.168672 Jan 19 16:28:37.283165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 337/635] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:37 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:37.288022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3d125f59-bde7-4a6a-aee6-e02897727def tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:37.288914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3d125f59-bde7-4a6a-aee6-e02897727def tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:37.295162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d125f59-bde7-4a6a-aee6-e02897727def tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:37.295769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d125f59-bde7-4a6a-aee6-e02897727def tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:37.302125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d125f59-bde7-4a6a-aee6-e02897727def tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:37.302125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d125f59-bde7-4a6a-aee6-e02897727def tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:37.328366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3d125f59-bde7-4a6a-aee6-e02897727def tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Jan 19 16:28:37.328956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 338/636] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:38.300905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:38.301567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:38.307930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:38.308386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:38.309177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:38.309616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:38.444151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:38.452690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:38.454002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:38.455155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-57309c7a-3106-45c4-ad62-e101ce878f7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158006 Jan 19 16:28:38.455881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 339/637] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:38 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:38.460928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0f40a0c4-ee61-40a7-b37a-17b1c7d7e13c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:38.461836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0f40a0c4-ee61-40a7-b37a-17b1c7d7e13c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:38.467916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f40a0c4-ee61-40a7-b37a-17b1c7d7e13c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:38.468425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f40a0c4-ee61-40a7-b37a-17b1c7d7e13c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:38.469165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f40a0c4-ee61-40a7-b37a-17b1c7d7e13c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:38.469607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f40a0c4-ee61-40a7-b37a-17b1c7d7e13c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:38.499987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0f40a0c4-ee61-40a7-b37a-17b1c7d7e13c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042993 Jan 19 16:28:38.500566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 340/638] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:39.478398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:39.479080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:39.486020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:39.486481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:39.487277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:39.487759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:39.618576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:39.627061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:39.628612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:39.629758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1a21c010-0dd7-4acd-baa3-f8d1ff8041bb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155668 Jan 19 16:28:39.630318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 341/639] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:39 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:39.634780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6269eab1-05fc-4780-b94f-1b95828427ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:39.635736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6269eab1-05fc-4780-b94f-1b95828427ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:39.642005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6269eab1-05fc-4780-b94f-1b95828427ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:39.642509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6269eab1-05fc-4780-b94f-1b95828427ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:39.643322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6269eab1-05fc-4780-b94f-1b95828427ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:39.643778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6269eab1-05fc-4780-b94f-1b95828427ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:39.674362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6269eab1-05fc-4780-b94f-1b95828427ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042992 Jan 19 16:28:39.674937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 342/640] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:40.652058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:40.652700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:40.658857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:40.659308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:40.660403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:40.660839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:40.791128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:40.799395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:40.800906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:40.802070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0eea0577-f2fa-4cfb-b064-f87a5e8e26bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153836 Jan 19 16:28:40.802632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 343/641] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:40 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:40.807463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6c94530-1113-437a-a780-93141981bfe2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:40.808386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6c94530-1113-437a-a780-93141981bfe2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:40.814107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c94530-1113-437a-a780-93141981bfe2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:40.814560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c94530-1113-437a-a780-93141981bfe2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:40.815343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c94530-1113-437a-a780-93141981bfe2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:40.815841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c94530-1113-437a-a780-93141981bfe2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:40.844286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6c94530-1113-437a-a780-93141981bfe2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040683 Jan 19 16:28:40.844842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 344/642] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:41.821015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:41.821676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:41.827882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:41.828339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:41.829153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:41.829590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:41.966727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:41.975936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:41.977455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:41.978612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9397e94-f980-4486-ac48-a6fd3e2f0016 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161347 Jan 19 16:28:41.979181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 345/643] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:41 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:41.983689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-73fdd641-243e-4c9d-a934-1e542ba8f643 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:41.984601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-73fdd641-243e-4c9d-a934-1e542ba8f643 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:41.991544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73fdd641-243e-4c9d-a934-1e542ba8f643 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:41.992045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73fdd641-243e-4c9d-a934-1e542ba8f643 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:41.992832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73fdd641-243e-4c9d-a934-1e542ba8f643 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:41.993267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73fdd641-243e-4c9d-a934-1e542ba8f643 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:42.022694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-73fdd641-243e-4c9d-a934-1e542ba8f643 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041934 Jan 19 16:28:42.023255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 346/644] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:42.997388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:42.998051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:43.004245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:43.004690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:43.005457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:43.005893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:43.145921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:43.154332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:43.155825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:43.156955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c2e6b2c0-515a-4bfc-b90f-608d0405ec38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163298 Jan 19 16:28:43.157509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 347/645] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:42 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:43.162098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f894f742-b03d-49a5-a1ed-0b66254ee1f1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:43.163518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f894f742-b03d-49a5-a1ed-0b66254ee1f1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:43.169208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f894f742-b03d-49a5-a1ed-0b66254ee1f1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:43.169659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f894f742-b03d-49a5-a1ed-0b66254ee1f1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:43.170430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f894f742-b03d-49a5-a1ed-0b66254ee1f1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:43.170856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f894f742-b03d-49a5-a1ed-0b66254ee1f1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:43.198951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f894f742-b03d-49a5-a1ed-0b66254ee1f1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040447 Jan 19 16:28:43.199823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 348/646] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:44.176023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:44.176704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:44.183588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:44.184059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:44.184839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:44.185263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:44.313730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:44.321811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:44.323307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:44.324464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-96793beb-64b6-4689-bab8-33312d070675 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152255 Jan 19 16:28:44.325024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 349/647] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:44 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:44.329320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-25ed2503-9f03-41bb-8f8a-52baa46276d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:44.330213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-25ed2503-9f03-41bb-8f8a-52baa46276d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:44.336973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25ed2503-9f03-41bb-8f8a-52baa46276d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:44.337362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25ed2503-9f03-41bb-8f8a-52baa46276d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:44.338135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25ed2503-9f03-41bb-8f8a-52baa46276d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:44.338578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25ed2503-9f03-41bb-8f8a-52baa46276d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:44.367037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-25ed2503-9f03-41bb-8f8a-52baa46276d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Jan 19 16:28:44.372201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 350/648] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:45.343909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:45.344589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:45.350443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:45.350901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:45.352164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:45.352934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:45.491486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:45.499741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:45.501340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:45.502477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9288f7e1-0c37-4910-9a9a-f834abd48856 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163076 Jan 19 16:28:45.503036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 351/649] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:45 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:45.507305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-58a9cb4b-6850-4e63-a887-26dd86b13fc1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:45.508227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-58a9cb4b-6850-4e63-a887-26dd86b13fc1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:45.513834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58a9cb4b-6850-4e63-a887-26dd86b13fc1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:45.514288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58a9cb4b-6850-4e63-a887-26dd86b13fc1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:45.515066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58a9cb4b-6850-4e63-a887-26dd86b13fc1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:45.515506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58a9cb4b-6850-4e63-a887-26dd86b13fc1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:45.544364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-58a9cb4b-6850-4e63-a887-26dd86b13fc1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040314 Jan 19 16:28:45.544974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 352/650] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:46.520635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:46.521299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:46.528179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:46.528627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:46.529408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:46.529834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:46.668267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:46.677207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:46.679439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:46.680664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8c2894b4-76ac-48b1-8253-8665d1f600cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163803 Jan 19 16:28:46.681224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 353/651] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:46 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:46.685787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e89b5280-382d-401e-b0b5-f25e68cfaf5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:46.686706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e89b5280-382d-401e-b0b5-f25e68cfaf5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:46.693151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e89b5280-382d-401e-b0b5-f25e68cfaf5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:46.693614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e89b5280-382d-401e-b0b5-f25e68cfaf5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:46.694986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e89b5280-382d-401e-b0b5-f25e68cfaf5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:46.695422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e89b5280-382d-401e-b0b5-f25e68cfaf5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:46.725883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e89b5280-382d-401e-b0b5-f25e68cfaf5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Jan 19 16:28:46.726460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 354/652] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:47.699927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:47.700554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:47.706917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:47.707361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:47.708151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:47.708587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:47.846186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:47.854279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:47.855808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:47.856948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fe2fb41f-efa0-473a-b537-3cb207e3e8a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.160697 Jan 19 16:28:47.857510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 355/653] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:47 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:47.861770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3fc5d559-65c9-4771-918e-d5c41db07b2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:47.862662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3fc5d559-65c9-4771-918e-d5c41db07b2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:47.868894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fc5d559-65c9-4771-918e-d5c41db07b2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:47.869372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fc5d559-65c9-4771-918e-d5c41db07b2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:47.870176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fc5d559-65c9-4771-918e-d5c41db07b2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:47.870619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fc5d559-65c9-4771-918e-d5c41db07b2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:47.900018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3fc5d559-65c9-4771-918e-d5c41db07b2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Jan 19 16:28:47.900585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 356/654] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:48.875784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:48.876463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:48.883185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:48.883634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:48.884439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:48.884868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:49.021827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:49.031352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:49.032782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:49.033937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7848ca4c-a25f-4b1f-8357-1b0c8aa51114 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162333 Jan 19 16:28:49.035788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 357/655] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:48 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:49.039080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5e350379-06dd-4131-bb7d-c7a640adbb56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:49.040008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5e350379-06dd-4131-bb7d-c7a640adbb56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:49.045820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e350379-06dd-4131-bb7d-c7a640adbb56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:49.046274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e350379-06dd-4131-bb7d-c7a640adbb56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:49.047058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e350379-06dd-4131-bb7d-c7a640adbb56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:49.047501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e350379-06dd-4131-bb7d-c7a640adbb56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:49.077046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5e350379-06dd-4131-bb7d-c7a640adbb56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041207 Jan 19 16:28:49.077688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 358/656] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:50.053783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:50.054477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:50.061016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:50.061468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:50.062258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:50.062691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:50.205460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:50.214374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:50.215952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:50.217119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bd28c78b-e49f-4ace-b28e-cf646d3a9adb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.167038 Jan 19 16:28:50.217885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 359/657] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:50 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:50.222087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5cca2d2b-b978-4576-bd4b-39fabd094d1a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:50.224095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5cca2d2b-b978-4576-bd4b-39fabd094d1a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:50.229703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cca2d2b-b978-4576-bd4b-39fabd094d1a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:50.230160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cca2d2b-b978-4576-bd4b-39fabd094d1a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:50.230953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cca2d2b-b978-4576-bd4b-39fabd094d1a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:50.231392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cca2d2b-b978-4576-bd4b-39fabd094d1a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:50.259821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5cca2d2b-b978-4576-bd4b-39fabd094d1a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041132 Jan 19 16:28:50.260387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 360/658] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:51.236661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:51.237312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:51.243407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:51.243890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:51.244672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:51.245104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:51.387143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:51.395219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:51.396853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:51.398151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be9fc167-3efc-45bf-9860-29d89527c8f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165363 Jan 19 16:28:51.398772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 361/659] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:51 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:51.403538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1b28187d-2f27-41ed-935d-bcf133ed6fa9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:51.404559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1b28187d-2f27-41ed-935d-bcf133ed6fa9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:51.411030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b28187d-2f27-41ed-935d-bcf133ed6fa9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:51.411486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b28187d-2f27-41ed-935d-bcf133ed6fa9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:51.412340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b28187d-2f27-41ed-935d-bcf133ed6fa9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:51.412782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b28187d-2f27-41ed-935d-bcf133ed6fa9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:51.446850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1b28187d-2f27-41ed-935d-bcf133ed6fa9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046981 Jan 19 16:28:51.447438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 362/660] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:52.417218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:52.418002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:52.424998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:52.425456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:52.426261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:52.428201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:52.571228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:52.579975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:52.581450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:52.582646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2f80f6b1-1987-4085-af6f-cf4c6ac9c3e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.169759 Jan 19 16:28:52.583240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 363/661] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:52 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:52.588900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5374fb0c-34cc-4681-82f7-efa0447e165b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:52.589884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5374fb0c-34cc-4681-82f7-efa0447e165b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:52.596415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5374fb0c-34cc-4681-82f7-efa0447e165b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:52.596885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5374fb0c-34cc-4681-82f7-efa0447e165b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:52.597663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5374fb0c-34cc-4681-82f7-efa0447e165b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:52.598090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5374fb0c-34cc-4681-82f7-efa0447e165b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:52.630184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5374fb0c-34cc-4681-82f7-efa0447e165b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Jan 19 16:28:52.630853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 364/662] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:53.612030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:53.612809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:53.620779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:53.621409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:53.622496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:53.623211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:53.777382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:53.787469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:53.789692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:53.790923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9f1abd3-a38e-44fd-834b-e256d521736f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.183587 Jan 19 16:28:53.791523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 365/663] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:53 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:28:53.796397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-06d6e565-d681-41eb-ab1c-bbe5b5975a07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:53.797344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-06d6e565-d681-41eb-ab1c-bbe5b5975a07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:53.804834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06d6e565-d681-41eb-ab1c-bbe5b5975a07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:53.805352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06d6e565-d681-41eb-ab1c-bbe5b5975a07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:53.806158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06d6e565-d681-41eb-ab1c-bbe5b5975a07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:53.806600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06d6e565-d681-41eb-ab1c-bbe5b5975a07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:53.839548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-06d6e565-d681-41eb-ab1c-bbe5b5975a07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Jan 19 16:28:53.840177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 366/664] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:54.810654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:54.811411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:54.817730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:54.818168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:54.818965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:54.819403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:54.965113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:54.973541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:54.975028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:54.976736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-564e82c6-7671-4ae7-81d6-0707a071c7cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.169397 Jan 19 16:28:54.977294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 367/665] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:54 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:54.981754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d5442dc4-d0f7-4e46-ac47-bf16df1d77ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:54.982659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d5442dc4-d0f7-4e46-ac47-bf16df1d77ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:54.988944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5442dc4-d0f7-4e46-ac47-bf16df1d77ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:54.989388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5442dc4-d0f7-4e46-ac47-bf16df1d77ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:54.990171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5442dc4-d0f7-4e46-ac47-bf16df1d77ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:54.990603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5442dc4-d0f7-4e46-ac47-bf16df1d77ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:55.030411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d5442dc4-d0f7-4e46-ac47-bf16df1d77ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052059 Jan 19 16:28:55.030993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 368/666] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:55.994330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:55.995041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:56.001335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:56.001789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:56.002574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:56.003013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:56.143135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:56.154176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:56.155666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:56.156849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fbd7ceb8-9aa7-4c6f-9e49-81e3da61b0fe tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.166353 Jan 19 16:28:56.157412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 369/667] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:55 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:56.162068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3880fcce-9950-4fa4-ac33-30996381cd11 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:56.162990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3880fcce-9950-4fa4-ac33-30996381cd11 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:56.169627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3880fcce-9950-4fa4-ac33-30996381cd11 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:56.170088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3880fcce-9950-4fa4-ac33-30996381cd11 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:56.170894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3880fcce-9950-4fa4-ac33-30996381cd11 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:56.171338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3880fcce-9950-4fa4-ac33-30996381cd11 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:56.204681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3880fcce-9950-4fa4-ac33-30996381cd11 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046202 Jan 19 16:28:56.205429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 370/668] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:57.175792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:57.176496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:57.183483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:57.183982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:57.184779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:57.185221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:57.322535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:57.330678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:57.332183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:57.333312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1df9dff8-10c0-4384-82e5-8aedeafbe872 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161385 Jan 19 16:28:57.333870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 371/669] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:57 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:57.338128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-632b0474-4192-40be-bcc0-86ce3531c482 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:57.339028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-632b0474-4192-40be-bcc0-86ce3531c482 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:57.344862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632b0474-4192-40be-bcc0-86ce3531c482 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:57.345314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632b0474-4192-40be-bcc0-86ce3531c482 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:57.346099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632b0474-4192-40be-bcc0-86ce3531c482 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:57.346542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632b0474-4192-40be-bcc0-86ce3531c482 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:57.379043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-632b0474-4192-40be-bcc0-86ce3531c482 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Jan 19 16:28:57.379604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 372/670] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:58.350944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:58.351588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:58.357835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:58.358292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:58.359088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:58.359528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:58.499099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:58.508464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:58.509979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:58.511146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f678019e-38c3-4b78-bf4b-346b90a11a08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.164052 Jan 19 16:28:58.511932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 373/671] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:58 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:58.516308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3df7b7cb-79ee-49c3-9c29-dc7bf745a346 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:58.517229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3df7b7cb-79ee-49c3-9c29-dc7bf745a346 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:58.523313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df7b7cb-79ee-49c3-9c29-dc7bf745a346 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:58.523804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df7b7cb-79ee-49c3-9c29-dc7bf745a346 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:58.524609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df7b7cb-79ee-49c3-9c29-dc7bf745a346 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:58.525057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df7b7cb-79ee-49c3-9c29-dc7bf745a346 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:58.558642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3df7b7cb-79ee-49c3-9c29-dc7bf745a346 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Jan 19 16:28:58.559246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 374/672] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:28:59.530070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:59.530768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:59.537606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:59.538056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:59.538857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:59.539297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:59.681120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:59.689903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:59.691388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:28:59.692575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20778920-9551-4a9d-83db-50103274a153 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.166371 Jan 19 16:28:59.693138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 375/673] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:28:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:28:59.698083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aa460b2a-e33c-411b-ac28-c3c9b1b17ef7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:28:59.698986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aa460b2a-e33c-411b-ac28-c3c9b1b17ef7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:28:59.705732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa460b2a-e33c-411b-ac28-c3c9b1b17ef7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:59.705732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa460b2a-e33c-411b-ac28-c3c9b1b17ef7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:59.706236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa460b2a-e33c-411b-ac28-c3c9b1b17ef7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:28:59.706667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa460b2a-e33c-411b-ac28-c3c9b1b17ef7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:28:59.738354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aa460b2a-e33c-411b-ac28-c3c9b1b17ef7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Jan 19 16:28:59.738957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 376/674] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:28:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:00.710938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:00.711607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:00.718993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:00.719435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:00.720284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:00.720727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:00.863810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:00.872787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:00.874605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:00.875794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fccb2516-d486-4298-baab-38214ba3435b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.168771 Jan 19 16:29:00.876357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 377/675] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:00 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:00.881169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fd44dd6b-9f94-454f-8fba-a3312bd84620 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:00.882087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fd44dd6b-9f94-454f-8fba-a3312bd84620 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:00.888532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd44dd6b-9f94-454f-8fba-a3312bd84620 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:00.888984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd44dd6b-9f94-454f-8fba-a3312bd84620 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:00.889882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd44dd6b-9f94-454f-8fba-a3312bd84620 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:00.890316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd44dd6b-9f94-454f-8fba-a3312bd84620 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:00.922593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fd44dd6b-9f94-454f-8fba-a3312bd84620 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Jan 19 16:29:00.923259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 378/676] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:01.893819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:01.894504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:01.901400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:01.901857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:01.902657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:01.903090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:02.065274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:02.074802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:02.076368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:02.077585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b0315aa7-d163-44ab-a43d-aee4fb76271a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.187552 Jan 19 16:29:02.078135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 379/677] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:02.082706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c56472e3-09a3-49ed-9792-e279061d01ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:02.083632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c56472e3-09a3-49ed-9792-e279061d01ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:02.090252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c56472e3-09a3-49ed-9792-e279061d01ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:02.090701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c56472e3-09a3-49ed-9792-e279061d01ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:02.091506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c56472e3-09a3-49ed-9792-e279061d01ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:02.091981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c56472e3-09a3-49ed-9792-e279061d01ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:02.123887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c56472e3-09a3-49ed-9792-e279061d01ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Jan 19 16:29:02.124479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 380/678] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:03.095593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:03.096325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:03.102784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:03.103235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:03.104163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:03.104601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:03.252978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:03.264293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:03.266940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:03.268705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-83c6bce8-a6da-48b9-9fc3-3e4d7345a6af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.176794 Jan 19 16:29:03.269701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 381/679] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:03 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:03.278431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7f0cbe79-f3cf-4267-832a-0b58ee98d171 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:03.279644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7f0cbe79-f3cf-4267-832a-0b58ee98d171 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:03.285969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f0cbe79-f3cf-4267-832a-0b58ee98d171 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:03.286427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f0cbe79-f3cf-4267-832a-0b58ee98d171 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:03.287219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f0cbe79-f3cf-4267-832a-0b58ee98d171 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:03.287665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f0cbe79-f3cf-4267-832a-0b58ee98d171 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:03.319087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7f0cbe79-f3cf-4267-832a-0b58ee98d171 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047917 Jan 19 16:29:03.320332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 382/680] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:04.287439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:04.288710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:04.294896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:04.295340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:04.296140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:04.296570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:04.425389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:04.433952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:04.435470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:04.436666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fac5669a-8619-4d2e-9cb4-f7aaa7541bf6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153173 Jan 19 16:29:04.437425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 383/681] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:04 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:04.441771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc021d66-3815-4b4d-9b54-45f6eab963b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:04.442672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc021d66-3815-4b4d-9b54-45f6eab963b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:04.448644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc021d66-3815-4b4d-9b54-45f6eab963b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:04.449104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc021d66-3815-4b4d-9b54-45f6eab963b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:04.449914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc021d66-3815-4b4d-9b54-45f6eab963b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:04.450335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc021d66-3815-4b4d-9b54-45f6eab963b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:04.480998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc021d66-3815-4b4d-9b54-45f6eab963b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Jan 19 16:29:04.481560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 384/682] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:05.465683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:05.466375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:05.472644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:05.473097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:05.473884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:05.474323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:05.606929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:05.615223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:05.617319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:05.618397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0b61fa0a-a959-48c6-b3a1-cfea4ea7611c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156718 Jan 19 16:29:05.618958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 385/683] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:05 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:05.623211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-38592d59-bf2d-4f2c-92bb-8b57584db3a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:05.624239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-38592d59-bf2d-4f2c-92bb-8b57584db3a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:05.629722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38592d59-bf2d-4f2c-92bb-8b57584db3a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:05.630173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38592d59-bf2d-4f2c-92bb-8b57584db3a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:05.630958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38592d59-bf2d-4f2c-92bb-8b57584db3a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:05.631401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38592d59-bf2d-4f2c-92bb-8b57584db3a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:05.660139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-38592d59-bf2d-4f2c-92bb-8b57584db3a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040133 Jan 19 16:29:05.660702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 386/684] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:06.636538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:06.637173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:06.643370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:06.643867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:06.644657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:06.645099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:06.782203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:06.792177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:06.793669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:06.794836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d11f6891-dfd4-4f54-85c7-ba5149a405e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162066 Jan 19 16:29:06.795393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 387/685] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:06 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:06.799852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b0cc1937-2608-44e4-bac0-2b3a3bed81e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:06.800814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b0cc1937-2608-44e4-bac0-2b3a3bed81e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:06.806897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0cc1937-2608-44e4-bac0-2b3a3bed81e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:06.807346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0cc1937-2608-44e4-bac0-2b3a3bed81e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:06.808172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0cc1937-2608-44e4-bac0-2b3a3bed81e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:06.808612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0cc1937-2608-44e4-bac0-2b3a3bed81e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:06.838592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b0cc1937-2608-44e4-bac0-2b3a3bed81e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Jan 19 16:29:06.839166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 388/686] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:07.813509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:07.814178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:07.821605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:07.822118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:07.822918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:07.824381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:07.973438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:07.981935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:07.983448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:07.984678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ee973f0b-a88d-4b1a-a652-0637eaed5fbb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.174862 Jan 19 16:29:07.985240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 389/687] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:07.989831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-13b38b31-6cf7-4c20-8933-65ae100210c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:07.990786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-13b38b31-6cf7-4c20-8933-65ae100210c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:07.999881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13b38b31-6cf7-4c20-8933-65ae100210c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:08.000633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13b38b31-6cf7-4c20-8933-65ae100210c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:08.001618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13b38b31-6cf7-4c20-8933-65ae100210c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:08.002280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13b38b31-6cf7-4c20-8933-65ae100210c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:08.033257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-13b38b31-6cf7-4c20-8933-65ae100210c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046954 Jan 19 16:29:08.033837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 390/688] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:09.003438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:09.004154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:09.010981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:09.011439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:09.012259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:09.012701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:09.149275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:09.158339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:09.160158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:09.161337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ec95a9d-80a4-439e-83da-22466d81c345 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161593 Jan 19 16:29:09.161914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 391/689] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:08 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:09.167039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-17340d10-7d09-4608-806d-49fd096315d0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:09.168009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-17340d10-7d09-4608-806d-49fd096315d0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:09.174623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17340d10-7d09-4608-806d-49fd096315d0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:09.175066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17340d10-7d09-4608-806d-49fd096315d0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:09.175910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17340d10-7d09-4608-806d-49fd096315d0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:09.176352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-17340d10-7d09-4608-806d-49fd096315d0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:09.209556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-17340d10-7d09-4608-806d-49fd096315d0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Jan 19 16:29:09.210209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 392/690] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:10.180675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:10.181325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:10.187630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:10.188116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:10.188906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:10.189347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:10.327945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:10.338102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:10.339623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:10.340797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c287f2bc-fa21-4087-87e1-96c5a03c93ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163805 Jan 19 16:29:10.341362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 393/691] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:10 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:10.345759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-36452baa-9730-44b1-a3ac-7200d4c8995c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:10.346660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-36452baa-9730-44b1-a3ac-7200d4c8995c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:10.353299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36452baa-9730-44b1-a3ac-7200d4c8995c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:10.353751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36452baa-9730-44b1-a3ac-7200d4c8995c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:10.354541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36452baa-9730-44b1-a3ac-7200d4c8995c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:10.354979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36452baa-9730-44b1-a3ac-7200d4c8995c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:10.384445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-36452baa-9730-44b1-a3ac-7200d4c8995c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Jan 19 16:29:10.385033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 394/692] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:11.358998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:11.359706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:11.367374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:11.367932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:11.368841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:11.369327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:11.511652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:11.520483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:11.521988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:11.523181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cb11a24b-29d0-450f-a56c-e325b89d63af tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.167887 Jan 19 16:29:11.523763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 395/693] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:11 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:11.528310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b0e65ef6-fa6d-4ff2-a075-55c551ba90e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:11.529229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b0e65ef6-fa6d-4ff2-a075-55c551ba90e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:11.540166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e65ef6-fa6d-4ff2-a075-55c551ba90e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:11.540979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e65ef6-fa6d-4ff2-a075-55c551ba90e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:11.542413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e65ef6-fa6d-4ff2-a075-55c551ba90e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:11.543217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e65ef6-fa6d-4ff2-a075-55c551ba90e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:11.577779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b0e65ef6-fa6d-4ff2-a075-55c551ba90e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052951 Jan 19 16:29:11.578364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 396/694] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:12.542493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:12.543231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:12.549771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:12.550236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:12.551026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:12.551467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:12.690981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:12.700401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:12.701897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:12.703199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-05393f59-6436-4e07-bcca-8a586bc5d6f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.164595 Jan 19 16:29:12.703923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 397/695] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:12.712455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e34409c7-2bae-4c35-8663-cf6b14af9fde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:12.714130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e34409c7-2bae-4c35-8663-cf6b14af9fde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:12.724404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e34409c7-2bae-4c35-8663-cf6b14af9fde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:12.724908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e34409c7-2bae-4c35-8663-cf6b14af9fde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:12.725787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e34409c7-2bae-4c35-8663-cf6b14af9fde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:12.726267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e34409c7-2bae-4c35-8663-cf6b14af9fde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:12.759269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e34409c7-2bae-4c35-8663-cf6b14af9fde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053920 Jan 19 16:29:12.759910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 398/696] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:13.731171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:13.731887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:13.738783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:13.739227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:13.740039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:13.740468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:13.881710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:13.890335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:13.891848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:13.893050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f315052d-74af-4ba4-beeb-8f60989313c8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165545 Jan 19 16:29:13.893604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 399/697] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:13.898687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-08e3248a-0554-4c93-8cdd-566ec89415a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:13.899728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-08e3248a-0554-4c93-8cdd-566ec89415a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:13.907751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08e3248a-0554-4c93-8cdd-566ec89415a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:13.908576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08e3248a-0554-4c93-8cdd-566ec89415a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:13.910234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08e3248a-0554-4c93-8cdd-566ec89415a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:13.911008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08e3248a-0554-4c93-8cdd-566ec89415a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:13.945684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-08e3248a-0554-4c93-8cdd-566ec89415a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050936 Jan 19 16:29:13.946174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 400/698] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:14.912802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:14.913501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:14.920165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:14.920618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:14.921411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:14.921852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:15.071490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:15.081294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:15.082790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:15.084487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9457455-0611-4677-bd17-7894d354f598 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.175491 Jan 19 16:29:15.085085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 401/699] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:14 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:15.089932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f80051a7-78d5-4b49-801b-55649161afe3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:15.090838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f80051a7-78d5-4b49-801b-55649161afe3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:15.097587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f80051a7-78d5-4b49-801b-55649161afe3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:15.098576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f80051a7-78d5-4b49-801b-55649161afe3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:15.098882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f80051a7-78d5-4b49-801b-55649161afe3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:15.099339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f80051a7-78d5-4b49-801b-55649161afe3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:15.132509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f80051a7-78d5-4b49-801b-55649161afe3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 Jan 19 16:29:15.133107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 402/700] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:16.105854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:16.106563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:16.113135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:16.113586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:16.114398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:16.114840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:16.262539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:16.271113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:16.272722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:16.273871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d70f2ce9-df80-4eb4-87b6-2cad91fb92ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.171823 Jan 19 16:29:16.274428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 403/701] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:16.278780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4c3b716b-b1fb-4c3e-acc1-9ffce0d4af86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:16.279700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4c3b716b-b1fb-4c3e-acc1-9ffce0d4af86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:16.286026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c3b716b-b1fb-4c3e-acc1-9ffce0d4af86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:16.286468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c3b716b-b1fb-4c3e-acc1-9ffce0d4af86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:16.287250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c3b716b-b1fb-4c3e-acc1-9ffce0d4af86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:16.287736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c3b716b-b1fb-4c3e-acc1-9ffce0d4af86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:16.318750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4c3b716b-b1fb-4c3e-acc1-9ffce0d4af86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043265 Jan 19 16:29:16.319978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 404/702] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:17.292830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:17.293507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:17.300082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:17.300541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:17.301368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:17.301827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:17.446269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:17.454865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:17.456406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:17.457550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79727ceb-da62-4b3c-8d23-3b4e21a02651 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.168649 Jan 19 16:29:17.458110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 405/703] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:17 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:17.463000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1a81d50d-bde7-4dfd-aedc-d3ad2063913c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:17.463940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1a81d50d-bde7-4dfd-aedc-d3ad2063913c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:17.471364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a81d50d-bde7-4dfd-aedc-d3ad2063913c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:17.472053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a81d50d-bde7-4dfd-aedc-d3ad2063913c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:17.473447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a81d50d-bde7-4dfd-aedc-d3ad2063913c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:17.474242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a81d50d-bde7-4dfd-aedc-d3ad2063913c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:17.506031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1a81d50d-bde7-4dfd-aedc-d3ad2063913c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Jan 19 16:29:17.507110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 406/704] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:18.477122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:18.477789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:18.483946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:18.484389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:18.485178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:18.485605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:18.625475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:18.633601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:18.635074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:18.636237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6eb07be8-94f4-4f85-b0e0-ccef82b7c960 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163409 Jan 19 16:29:18.636791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 407/705] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:18 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:18.640973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bdb08c33-eb2c-4680-b437-8c31760ca8b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:18.641858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bdb08c33-eb2c-4680-b437-8c31760ca8b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:18.647921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdb08c33-eb2c-4680-b437-8c31760ca8b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:18.648363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdb08c33-eb2c-4680-b437-8c31760ca8b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:18.649133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdb08c33-eb2c-4680-b437-8c31760ca8b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:18.649565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdb08c33-eb2c-4680-b437-8c31760ca8b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:18.678355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bdb08c33-eb2c-4680-b437-8c31760ca8b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040559 Jan 19 16:29:18.678917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 408/706] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:19.654191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:19.654862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:19.661632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:19.662104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:19.663453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:19.663928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:19.809942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:19.819866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:19.821371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:19.822526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8a064922-6b80-43ca-89b8-3c16abf7e5f3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.172104 Jan 19 16:29:19.823094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 409/707] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:19.832120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3b0eb4f6-72fd-4aca-be44-f0338dc9e814 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:19.832120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3b0eb4f6-72fd-4aca-be44-f0338dc9e814 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:19.835546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4f6-72fd-4aca-be44-f0338dc9e814 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:19.836032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4f6-72fd-4aca-be44-f0338dc9e814 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:19.836835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4f6-72fd-4aca-be44-f0338dc9e814 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:19.837284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b0eb4f6-72fd-4aca-be44-f0338dc9e814 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:19.868772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3b0eb4f6-72fd-4aca-be44-f0338dc9e814 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Jan 19 16:29:19.869354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 410/708] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:20.841803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:20.842478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:20.848850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:20.849310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:20.850113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:20.850556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:21.073342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:21.081678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:21.083163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:21.084372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-59b921a9-da61-4da2-82fc-aa81fe23b42f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.246337 Jan 19 16:29:21.084956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 411/709] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:20 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:21.089412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c4dd835f-0736-4d18-a79b-aa8fe66fea8c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:21.090304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c4dd835f-0736-4d18-a79b-aa8fe66fea8c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:21.096151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4dd835f-0736-4d18-a79b-aa8fe66fea8c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:21.096621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4dd835f-0736-4d18-a79b-aa8fe66fea8c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:21.097539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4dd835f-0736-4d18-a79b-aa8fe66fea8c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:21.097843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4dd835f-0736-4d18-a79b-aa8fe66fea8c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:21.129193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c4dd835f-0736-4d18-a79b-aa8fe66fea8c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Jan 19 16:29:21.129725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 412/710] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:22.104513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:22.105551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:22.112926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:22.113379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:22.114174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:22.114615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:22.274441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:22.287198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:22.289286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:22.290444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-afb306cb-4802-44ef-8863-d345fa4ddc26 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.191807 Jan 19 16:29:22.291010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 413/711] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:22 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:22.297486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7e09ecb3-80eb-461c-a535-53faca7cfb48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:22.298584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7e09ecb3-80eb-461c-a535-53faca7cfb48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:22.305313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e09ecb3-80eb-461c-a535-53faca7cfb48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:22.305759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e09ecb3-80eb-461c-a535-53faca7cfb48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:22.306561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e09ecb3-80eb-461c-a535-53faca7cfb48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:22.306996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e09ecb3-80eb-461c-a535-53faca7cfb48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:22.348801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7e09ecb3-80eb-461c-a535-53faca7cfb48 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056511 Jan 19 16:29:22.349421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 414/712] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:23.135851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:23.136536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:23.142790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:23.143205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:23.144008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:23.144450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:28.357509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:29:28.358420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments/0d842211-63a9-4d6f-88fa-689e9984aa57 (ip 10.222.0.42) !!! Jan 19 16:29:29.358280 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.objects.instance [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lazy-loading 'services' on Instance uuid 06f71c7f-dd64-49e3-b9fe-5096584b8e66 {{(pid=116209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:29:29.545540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lazy-loading 'services' on Instance uuid 06f71c7f-dd64-49e3-b9fe-5096584b8e66 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:29:29.633562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-28c859fe-4a96-4e7a-a99f-430b9400a987 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments/0d842211-63a9-4d6f-88fa-689e9984aa57" status: 202 len: 0 microversion: 2.1 time: 66.557667 Jan 19 16:29:29.634404 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 299/713] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:28:23 2022] DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments/0d842211-63a9-4d6f-88fa-689e9984aa57 => generated 0 bytes in 66559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:29:29.640594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:29.642958 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:29.652268 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:29.652978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:29.653801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:29.654253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:29.659476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bef13667-0df3-4d18-a569-26cb97ab2f20) Jan 19 16:29:29.660577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bef13667-0df3-4d18-a569-26cb97ab2f20) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:29:29.662125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7038005b-b001-46f0-91c1-faeef0879f42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments/0d842211-63a9-4d6f-88fa-689e9984aa57" status: 400 len: 269 microversion: 2.1 time: 6.529905 Jan 19 16:29:29.665238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 415/714] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:29:23 2022] DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments/0d842211-63a9-4d6f-88fa-689e9984aa57 => generated 269 bytes in 6532 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 19 16:29:29.670883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1d0571da-2fd1-4223-80c6-c164c2119281 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:29.683759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1d0571da-2fd1-4223-80c6-c164c2119281 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:29.689603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d0571da-2fd1-4223-80c6-c164c2119281 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:29.690051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d0571da-2fd1-4223-80c6-c164c2119281 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:29.690938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d0571da-2fd1-4223-80c6-c164c2119281 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:29.691476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d0571da-2fd1-4223-80c6-c164c2119281 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:29.727228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1d0571da-2fd1-4223-80c6-c164c2119281 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062053 Jan 19 16:29:29.728636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 416/715] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:29.744822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-77ae8f23-32fc-4831-9a74-496f2a4bc84c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:29.745800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-77ae8f23-32fc-4831-9a74-496f2a4bc84c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:29.752510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ae8f23-32fc-4831-9a74-496f2a4bc84c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:29.752974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ae8f23-32fc-4831-9a74-496f2a4bc84c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:29.753945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ae8f23-32fc-4831-9a74-496f2a4bc84c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:29.754400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ae8f23-32fc-4831-9a74-496f2a4bc84c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:29.787786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-77ae8f23-32fc-4831-9a74-496f2a4bc84c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046729 Jan 19 16:29:29.792242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 417/716] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:29.838899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:29.848679 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:29.850823 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:29.852016 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1fc018c7-08a6-4182-ac33-7aa98620434f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.216480 Jan 19 16:29:29.852584 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 300/717] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:29 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:30.739033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9297c5a-409d-47a0-a252-31ab457bab93 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:30.739971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9297c5a-409d-47a0-a252-31ab457bab93 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:30.746226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9297c5a-409d-47a0-a252-31ab457bab93 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:30.746686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9297c5a-409d-47a0-a252-31ab457bab93 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:30.747466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9297c5a-409d-47a0-a252-31ab457bab93 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:30.747936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9297c5a-409d-47a0-a252-31ab457bab93 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:30.778972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9297c5a-409d-47a0-a252-31ab457bab93 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Jan 19 16:29:30.779455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 418/718] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:30.799525 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6f66b08a-7404-40b1-96ea-26b865e9fecc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:30.800523 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6f66b08a-7404-40b1-96ea-26b865e9fecc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:30.806775 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6f66b08a-7404-40b1-96ea-26b865e9fecc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:30.807248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6f66b08a-7404-40b1-96ea-26b865e9fecc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:30.808054 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6f66b08a-7404-40b1-96ea-26b865e9fecc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:30.808489 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6f66b08a-7404-40b1-96ea-26b865e9fecc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:30.838339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6f66b08a-7404-40b1-96ea-26b865e9fecc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Jan 19 16:29:30.838897 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 301/719] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:30.871761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:30.872361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:30.878261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:30.879906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:30.879906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:30.879906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:31.014783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:31.024044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:31.025533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:31.026685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-683e3125-6dd4-4001-9de9-60cc767de19d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158636 Jan 19 16:29:31.027244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 419/720] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:30 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:31.791142 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-98d9bdfd-6f96-4d4c-9614-5aaccb3cf339 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:31.792021 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-98d9bdfd-6f96-4d4c-9614-5aaccb3cf339 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:31.797912 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98d9bdfd-6f96-4d4c-9614-5aaccb3cf339 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:31.798360 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98d9bdfd-6f96-4d4c-9614-5aaccb3cf339 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:31.799137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98d9bdfd-6f96-4d4c-9614-5aaccb3cf339 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:31.799568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98d9bdfd-6f96-4d4c-9614-5aaccb3cf339 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:31.830001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-98d9bdfd-6f96-4d4c-9614-5aaccb3cf339 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Jan 19 16:29:31.830583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 302/721] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:31.850711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ad81e706-fc45-4c40-9422-a00e14b725cf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:31.851703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ad81e706-fc45-4c40-9422-a00e14b725cf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:31.858095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad81e706-fc45-4c40-9422-a00e14b725cf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:31.858542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad81e706-fc45-4c40-9422-a00e14b725cf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:31.859338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad81e706-fc45-4c40-9422-a00e14b725cf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:31.859796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad81e706-fc45-4c40-9422-a00e14b725cf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:31.890381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ad81e706-fc45-4c40-9422-a00e14b725cf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Jan 19 16:29:31.890951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 420/722] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:32.045422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:32.045932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:32.051893 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:32.052335 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:32.053255 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:32.053686 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:32.187494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:32.195892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:32.197435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:32.198611 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6b9ec80d-45a0-472f-ad64-3a26450288bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156966 Jan 19 16:29:32.199178 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 303/723] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:32 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:32.841749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d4e66ec5-8aff-48b7-9840-f17b36625fae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:32.842577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d4e66ec5-8aff-48b7-9840-f17b36625fae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:32.848721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4e66ec5-8aff-48b7-9840-f17b36625fae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:32.849086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4e66ec5-8aff-48b7-9840-f17b36625fae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:32.849879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4e66ec5-8aff-48b7-9840-f17b36625fae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:32.850325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4e66ec5-8aff-48b7-9840-f17b36625fae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:32.881443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d4e66ec5-8aff-48b7-9840-f17b36625fae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Jan 19 16:29:32.882100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 421/724] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:32.900572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-db6d3db3-bd9d-4ce6-acfa-a852a75ba710 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:32.901485 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-db6d3db3-bd9d-4ce6-acfa-a852a75ba710 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:32.907853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db6d3db3-bd9d-4ce6-acfa-a852a75ba710 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:32.908301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db6d3db3-bd9d-4ce6-acfa-a852a75ba710 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:32.909378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db6d3db3-bd9d-4ce6-acfa-a852a75ba710 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:32.909818 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db6d3db3-bd9d-4ce6-acfa-a852a75ba710 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:32.938712 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-db6d3db3-bd9d-4ce6-acfa-a852a75ba710 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 Jan 19 16:29:32.939267 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 304/725] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:33.217576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:33.218182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:33.224333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:33.224816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:33.225634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:33.226114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:33.365570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:33.376810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:33.378677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:33.380167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2b2f542f-41b1-4c6a-bf88-8cfcd5cd00cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.166411 Jan 19 16:29:33.381468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 422/726] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:33 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:33.893235 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f1f2cb54-697b-4dd9-84ca-15d417d8a94a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:33.894071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f1f2cb54-697b-4dd9-84ca-15d417d8a94a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:33.903071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f1f2cb54-697b-4dd9-84ca-15d417d8a94a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:33.903849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f1f2cb54-697b-4dd9-84ca-15d417d8a94a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:33.904952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f1f2cb54-697b-4dd9-84ca-15d417d8a94a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:33.905394 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f1f2cb54-697b-4dd9-84ca-15d417d8a94a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:33.942408 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f1f2cb54-697b-4dd9-84ca-15d417d8a94a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052969 Jan 19 16:29:33.943102 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 305/727] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:33.950733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8ae8d74d-d500-415f-8eea-125db3a26662 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:33.951665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8ae8d74d-d500-415f-8eea-125db3a26662 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:33.958677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ae8d74d-d500-415f-8eea-125db3a26662 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:33.959157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ae8d74d-d500-415f-8eea-125db3a26662 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:33.960002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ae8d74d-d500-415f-8eea-125db3a26662 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:33.960449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ae8d74d-d500-415f-8eea-125db3a26662 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:34.003153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8ae8d74d-d500-415f-8eea-125db3a26662 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056562 Jan 19 16:29:34.003783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 423/728] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:34.401307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:34.402035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:34.408616 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:34.409335 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:34.410139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:34.410580 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:34.581960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:34.591418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:34.592970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:34.594155 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c6ec393b-68e0-44e1-b5b3-da5b81160800 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.196755 Jan 19 16:29:34.594722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 306/729] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:34 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:34.954718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3fa8f663-c05c-48d9-83bc-0aea778cd1f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:34.955639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3fa8f663-c05c-48d9-83bc-0aea778cd1f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:34.962769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fa8f663-c05c-48d9-83bc-0aea778cd1f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:34.963227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fa8f663-c05c-48d9-83bc-0aea778cd1f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:34.964078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fa8f663-c05c-48d9-83bc-0aea778cd1f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:34.964522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fa8f663-c05c-48d9-83bc-0aea778cd1f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:34.995841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3fa8f663-c05c-48d9-83bc-0aea778cd1f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Jan 19 16:29:34.996432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 424/730] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:35.014232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-08003427-674a-402e-8c11-224970534b2e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:35.015146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-08003427-674a-402e-8c11-224970534b2e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:35.021714 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08003427-674a-402e-8c11-224970534b2e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:35.022159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08003427-674a-402e-8c11-224970534b2e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:35.022944 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08003427-674a-402e-8c11-224970534b2e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:35.023379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-08003427-674a-402e-8c11-224970534b2e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:35.055151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-08003427-674a-402e-8c11-224970534b2e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Jan 19 16:29:35.055752 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 307/731] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:35.612268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:35.612878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:35.619365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:35.619855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:35.620665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:35.621104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:35.783920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:35.792960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:35.794503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:35.795697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b42c7da6-4eab-4ad0-a519-502fdcd3f777 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.187166 Jan 19 16:29:35.796265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 425/732] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:35 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:36.007459 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0f6aa60a-4fef-4b9b-a1c2-8c96cad322df tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:36.008401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0f6aa60a-4fef-4b9b-a1c2-8c96cad322df tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:36.014701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0f6aa60a-4fef-4b9b-a1c2-8c96cad322df tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:36.015343 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0f6aa60a-4fef-4b9b-a1c2-8c96cad322df tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:36.015981 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0f6aa60a-4fef-4b9b-a1c2-8c96cad322df tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:36.016492 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0f6aa60a-4fef-4b9b-a1c2-8c96cad322df tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:36.048412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0f6aa60a-4fef-4b9b-a1c2-8c96cad322df tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Jan 19 16:29:36.048979 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 308/733] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:36.066200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fa6c2bc4-f473-40a2-b794-0fd69fb1fe7c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:36.067122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fa6c2bc4-f473-40a2-b794-0fd69fb1fe7c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:36.073589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa6c2bc4-f473-40a2-b794-0fd69fb1fe7c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:36.074045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa6c2bc4-f473-40a2-b794-0fd69fb1fe7c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:36.074842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa6c2bc4-f473-40a2-b794-0fd69fb1fe7c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:36.075284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa6c2bc4-f473-40a2-b794-0fd69fb1fe7c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:36.105321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fa6c2bc4-f473-40a2-b794-0fd69fb1fe7c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Jan 19 16:29:36.105900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 426/734] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:36.814155 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:36.814674 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:36.828593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:36.829458 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:36.830746 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:36.831552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:37.007496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:37.017099 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:37.018665 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:37.019885 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3ff85f40-0ad6-4dbc-b2f4-d3dffa39fc5d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.209474 Jan 19 16:29:37.020487 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 309/735] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:36 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:37.060065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e351d8b4-20b0-4a37-8901-f3703cb27be7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:37.060979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e351d8b4-20b0-4a37-8901-f3703cb27be7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:37.067099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e351d8b4-20b0-4a37-8901-f3703cb27be7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:37.067903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e351d8b4-20b0-4a37-8901-f3703cb27be7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:37.068877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e351d8b4-20b0-4a37-8901-f3703cb27be7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:37.069319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e351d8b4-20b0-4a37-8901-f3703cb27be7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:37.100381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e351d8b4-20b0-4a37-8901-f3703cb27be7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Jan 19 16:29:37.100949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 427/736] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:37.117215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ca9d9d6c-9b05-44a7-a7b3-9c1bed3e12e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:37.118166 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ca9d9d6c-9b05-44a7-a7b3-9c1bed3e12e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:37.125229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca9d9d6c-9b05-44a7-a7b3-9c1bed3e12e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:37.125689 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca9d9d6c-9b05-44a7-a7b3-9c1bed3e12e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:37.126472 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca9d9d6c-9b05-44a7-a7b3-9c1bed3e12e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:37.126913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca9d9d6c-9b05-44a7-a7b3-9c1bed3e12e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:37.157892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ca9d9d6c-9b05-44a7-a7b3-9c1bed3e12e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Jan 19 16:29:37.158475 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 310/737] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:38.038750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:38.039485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:38.049762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:38.050457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:38.051334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:38.051837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:38.112538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b986877f-15d8-4545-b7da-f7320b062198 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:38.113911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b986877f-15d8-4545-b7da-f7320b062198 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:38.122360 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b986877f-15d8-4545-b7da-f7320b062198 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:38.122962 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b986877f-15d8-4545-b7da-f7320b062198 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:38.124096 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b986877f-15d8-4545-b7da-f7320b062198 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:38.124635 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b986877f-15d8-4545-b7da-f7320b062198 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:38.171586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b986877f-15d8-4545-b7da-f7320b062198 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063030 Jan 19 16:29:38.175764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 311/738] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:38.181085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f0bf5b58-b463-498b-9235-d248642b0a6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:38.181990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f0bf5b58-b463-498b-9235-d248642b0a6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:38.188526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b58-b463-498b-9235-d248642b0a6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:38.188526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b58-b463-498b-9235-d248642b0a6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:38.189315 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b58-b463-498b-9235-d248642b0a6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:38.189743 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b58-b463-498b-9235-d248642b0a6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:38.216228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:38.221354 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f0bf5b58-b463-498b-9235-d248642b0a6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047126 Jan 19 16:29:38.222045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 312/739] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:38.225489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:38.226996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:38.228210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6439d8fa-02db-4b16-9505-238647acf3b7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.193349 Jan 19 16:29:38.228769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 428/740] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:38 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:39.183703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7490ae3d-4fdc-4589-a32c-6784b05ff112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:39.184692 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7490ae3d-4fdc-4589-a32c-6784b05ff112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:39.191494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7490ae3d-4fdc-4589-a32c-6784b05ff112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:39.191922 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7490ae3d-4fdc-4589-a32c-6784b05ff112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:39.192728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7490ae3d-4fdc-4589-a32c-6784b05ff112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:39.193702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7490ae3d-4fdc-4589-a32c-6784b05ff112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:39.232064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7490ae3d-4fdc-4589-a32c-6784b05ff112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052160 Jan 19 16:29:39.232640 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 313/741] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:39.233073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d24bf9e0-dc17-47fc-ab04-067e49a4d764 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:39.234014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d24bf9e0-dc17-47fc-ab04-067e49a4d764 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:39.241181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d24bf9e0-dc17-47fc-ab04-067e49a4d764 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:39.241608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d24bf9e0-dc17-47fc-ab04-067e49a4d764 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:39.242419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d24bf9e0-dc17-47fc-ab04-067e49a4d764 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:39.242863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d24bf9e0-dc17-47fc-ab04-067e49a4d764 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:39.246164 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:39.246774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:39.253104 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:39.253550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:39.254401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:39.254843 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:39.276035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d24bf9e0-dc17-47fc-ab04-067e49a4d764 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046775 Jan 19 16:29:39.276629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 429/742] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:39.398655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:39.408261 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:39.409334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:39.410528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e250c54e-5322-4ae0-a8ca-dc9599e74360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.168049 Jan 19 16:29:39.411118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 314/743] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:39 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:40.244323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-29fb6c5c-4e53-4e76-8efa-c5c5f2f4336a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:40.245513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-29fb6c5c-4e53-4e76-8efa-c5c5f2f4336a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:40.252798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29fb6c5c-4e53-4e76-8efa-c5c5f2f4336a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:40.253462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29fb6c5c-4e53-4e76-8efa-c5c5f2f4336a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:40.254481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29fb6c5c-4e53-4e76-8efa-c5c5f2f4336a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:40.254960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29fb6c5c-4e53-4e76-8efa-c5c5f2f4336a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:40.288111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5d77d673-9bc5-4afa-bd07-68a930f9259f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:40.289153 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5d77d673-9bc5-4afa-bd07-68a930f9259f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:40.289618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-29fb6c5c-4e53-4e76-8efa-c5c5f2f4336a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049631 Jan 19 16:29:40.290218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 430/744] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:40.296167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5d77d673-9bc5-4afa-bd07-68a930f9259f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:40.296626 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5d77d673-9bc5-4afa-bd07-68a930f9259f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:40.297423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5d77d673-9bc5-4afa-bd07-68a930f9259f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:40.297864 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5d77d673-9bc5-4afa-bd07-68a930f9259f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:40.329523 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5d77d673-9bc5-4afa-bd07-68a930f9259f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Jan 19 16:29:40.330101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 315/745] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:40.429382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:40.430020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:40.436675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:40.437131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:40.438003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:40.438452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:40.577888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:40.586579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:40.588135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:40.589351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4a7399d1-cef6-4419-a5ff-c2114028fc2a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.164187 Jan 19 16:29:40.589932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 431/746] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:40 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:41.344604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-29a6b503-b452-4634-83fa-fbc89ded91c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:41.346203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-29a6b503-b452-4634-83fa-fbc89ded91c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:41.356280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29a6b503-b452-4634-83fa-fbc89ded91c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:41.357209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29a6b503-b452-4634-83fa-fbc89ded91c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:41.358079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29a6b503-b452-4634-83fa-fbc89ded91c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:41.358707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29a6b503-b452-4634-83fa-fbc89ded91c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:41.409327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bca7fe41-9457-4fd3-8b40-47fb336e7394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:41.410569 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bca7fe41-9457-4fd3-8b40-47fb336e7394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:41.411965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-29a6b503-b452-4634-83fa-fbc89ded91c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073813 Jan 19 16:29:41.412956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 432/747] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:41.417104 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bca7fe41-9457-4fd3-8b40-47fb336e7394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:41.417558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bca7fe41-9457-4fd3-8b40-47fb336e7394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:41.418358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bca7fe41-9457-4fd3-8b40-47fb336e7394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:41.418801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bca7fe41-9457-4fd3-8b40-47fb336e7394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:41.453769 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bca7fe41-9457-4fd3-8b40-47fb336e7394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156214 Jan 19 16:29:41.454358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 316/748] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:41.727980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:41.728596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:41.734951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:41.735406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:41.736235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:41.736675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:41.895013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:41.905093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:41.906773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:41.908155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d533c715-804b-482a-8fdf-15942710ad68 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.304371 Jan 19 16:29:41.908771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 433/749] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:41 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:42.424197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-67644abc-9c96-46f4-8182-1c43bd99b64c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:42.425112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-67644abc-9c96-46f4-8182-1c43bd99b64c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:42.432111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67644abc-9c96-46f4-8182-1c43bd99b64c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:42.432561 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67644abc-9c96-46f4-8182-1c43bd99b64c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:42.433348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67644abc-9c96-46f4-8182-1c43bd99b64c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:42.433783 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-67644abc-9c96-46f4-8182-1c43bd99b64c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:42.465082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-67644abc-9c96-46f4-8182-1c43bd99b64c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Jan 19 16:29:42.465298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-19d30d90-2eea-4199-ad9a-f16d562534c5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:42.465731 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 317/750] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:42.466152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-19d30d90-2eea-4199-ad9a-f16d562534c5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:42.472905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19d30d90-2eea-4199-ad9a-f16d562534c5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:42.473363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19d30d90-2eea-4199-ad9a-f16d562534c5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:42.474164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19d30d90-2eea-4199-ad9a-f16d562534c5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:42.474605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19d30d90-2eea-4199-ad9a-f16d562534c5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:42.505069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-19d30d90-2eea-4199-ad9a-f16d562534c5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043560 Jan 19 16:29:42.506240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 434/751] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:42.928604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:42.929123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:42.936862 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:42.937317 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:42.938115 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:42.938552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:43.082167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:43.093904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:43.095477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:43.096765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7c5bac11-ef9d-44a5-b8e8-ff56643e790b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.173406 Jan 19 16:29:43.097348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 318/752] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:42 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:43.476527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ab3c158e-69da-4c89-ae80-4031c8fb45db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:43.477447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ab3c158e-69da-4c89-ae80-4031c8fb45db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:43.484080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3c158e-69da-4c89-ae80-4031c8fb45db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:43.484537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3c158e-69da-4c89-ae80-4031c8fb45db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:43.485337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3c158e-69da-4c89-ae80-4031c8fb45db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:43.485782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3c158e-69da-4c89-ae80-4031c8fb45db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:43.517172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ab3c158e-69da-4c89-ae80-4031c8fb45db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Jan 19 16:29:43.517645 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-96b24a13-a6f5-4176-9567-3fbc254a1571 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:43.518132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 435/753] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:43.518758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-96b24a13-a6f5-4176-9567-3fbc254a1571 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:43.526011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-96b24a13-a6f5-4176-9567-3fbc254a1571 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:43.526464 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-96b24a13-a6f5-4176-9567-3fbc254a1571 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:43.527265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-96b24a13-a6f5-4176-9567-3fbc254a1571 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:43.527797 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-96b24a13-a6f5-4176-9567-3fbc254a1571 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:43.558292 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-96b24a13-a6f5-4176-9567-3fbc254a1571 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Jan 19 16:29:43.558877 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 319/754] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:44.127112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:44.128250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:44.137018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:44.137466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:44.138266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:44.138708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:44.294042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:44.305032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:44.306520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:44.307710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cb0feccb-1326-49e1-9aff-671e317ed2e5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.187124 Jan 19 16:29:44.308282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 436/755] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:44 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:44.530896 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a190b649-bd62-487b-ba2f-a7165eff01ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:44.532548 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a190b649-bd62-487b-ba2f-a7165eff01ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:44.543421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a190b649-bd62-487b-ba2f-a7165eff01ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:44.544213 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a190b649-bd62-487b-ba2f-a7165eff01ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:44.545584 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a190b649-bd62-487b-ba2f-a7165eff01ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:44.546345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a190b649-bd62-487b-ba2f-a7165eff01ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:44.569995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3274a36-66c7-4256-8ac9-3aef84523377 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:44.570962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3274a36-66c7-4256-8ac9-3aef84523377 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:44.577389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3274a36-66c7-4256-8ac9-3aef84523377 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:44.577848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3274a36-66c7-4256-8ac9-3aef84523377 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:44.578650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3274a36-66c7-4256-8ac9-3aef84523377 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:44.579104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3274a36-66c7-4256-8ac9-3aef84523377 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:44.581904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a190b649-bd62-487b-ba2f-a7165eff01ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056422 Jan 19 16:29:44.582712 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 320/756] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:44.625134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3274a36-66c7-4256-8ac9-3aef84523377 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059434 Jan 19 16:29:44.625721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 437/757] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:45.326158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:45.326900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:45.332918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:45.333448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:45.334234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:45.334671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:45.467423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:45.476441 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:45.477915 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:45.479046 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a4af51c6-9130-47cc-b730-ccc102b3ce7a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156631 Jan 19 16:29:45.479615 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 321/758] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:45 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:45.594184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-154845fb-f379-41ab-914d-90c337e1037f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:45.595106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-154845fb-f379-41ab-914d-90c337e1037f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:45.602341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154845fb-f379-41ab-914d-90c337e1037f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:45.602796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154845fb-f379-41ab-914d-90c337e1037f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:45.603593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154845fb-f379-41ab-914d-90c337e1037f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:45.604237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154845fb-f379-41ab-914d-90c337e1037f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:45.634499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-154845fb-f379-41ab-914d-90c337e1037f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 Jan 19 16:29:45.635075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 438/759] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:45.638954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-147e2cb5-46ad-408d-a740-cb7d280a6300 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:45.639909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-147e2cb5-46ad-408d-a740-cb7d280a6300 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:45.647517 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-147e2cb5-46ad-408d-a740-cb7d280a6300 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:45.648011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-147e2cb5-46ad-408d-a740-cb7d280a6300 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:45.648843 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-147e2cb5-46ad-408d-a740-cb7d280a6300 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:45.649288 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-147e2cb5-46ad-408d-a740-cb7d280a6300 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:45.680523 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-147e2cb5-46ad-408d-a740-cb7d280a6300 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Jan 19 16:29:45.681105 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 322/760] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:46.496672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:46.497195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:46.503161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:46.503616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:46.504522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:46.504965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:46.640914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:46.645633 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bc65025e-8fd9-4039-9452-c0b80060ed11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:46.646581 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bc65025e-8fd9-4039-9452-c0b80060ed11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:46.649892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:46.651370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:46.652572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-22983b7d-3258-4b19-9646-e09adbf1e360 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159696 Jan 19 16:29:46.653133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 439/761] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:46 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:46.653245 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc65025e-8fd9-4039-9452-c0b80060ed11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:46.653586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc65025e-8fd9-4039-9452-c0b80060ed11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:46.654386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc65025e-8fd9-4039-9452-c0b80060ed11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:46.654821 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc65025e-8fd9-4039-9452-c0b80060ed11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:46.687891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bc65025e-8fd9-4039-9452-c0b80060ed11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Jan 19 16:29:46.688774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 323/762] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:46.692680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2169e37c-d2a6-4174-96b2-55fcf3fb08fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:46.693646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2169e37c-d2a6-4174-96b2-55fcf3fb08fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:46.699644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2169e37c-d2a6-4174-96b2-55fcf3fb08fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:46.700139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2169e37c-d2a6-4174-96b2-55fcf3fb08fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:46.700937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2169e37c-d2a6-4174-96b2-55fcf3fb08fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:46.701375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2169e37c-d2a6-4174-96b2-55fcf3fb08fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:46.743658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2169e37c-d2a6-4174-96b2-55fcf3fb08fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054433 Jan 19 16:29:46.744783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 440/763] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:47.672265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:47.672884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:47.679437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:47.679935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:47.680733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:47.681169 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:47.700982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2b51a055-faa5-4db0-9762-92fb0a84a67c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:47.701910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2b51a055-faa5-4db0-9762-92fb0a84a67c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:47.709020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b51a055-faa5-4db0-9762-92fb0a84a67c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:47.709467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b51a055-faa5-4db0-9762-92fb0a84a67c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:47.710257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b51a055-faa5-4db0-9762-92fb0a84a67c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:47.710691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b51a055-faa5-4db0-9762-92fb0a84a67c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:47.742566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2b51a055-faa5-4db0-9762-92fb0a84a67c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Jan 19 16:29:47.743161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 441/764] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:47.758185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f717f562-4406-4709-8caf-f04c4dffd44b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:47.759592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f717f562-4406-4709-8caf-f04c4dffd44b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:47.767029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f717f562-4406-4709-8caf-f04c4dffd44b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:47.767475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f717f562-4406-4709-8caf-f04c4dffd44b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:47.768310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f717f562-4406-4709-8caf-f04c4dffd44b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:47.768777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f717f562-4406-4709-8caf-f04c4dffd44b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:47.801058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f717f562-4406-4709-8caf-f04c4dffd44b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048940 Jan 19 16:29:47.801551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 442/765] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:47.826885 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:47.836025 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:47.837548 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:47.838699 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5fc849ce-6881-488b-945f-a02b2fa34cb2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.170120 Jan 19 16:29:47.839275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 324/766] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:47 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:48.754243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4b8191a5-8046-47a8-92b0-6d421bb258a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:48.756008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4b8191a5-8046-47a8-92b0-6d421bb258a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:48.762430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b8191a5-8046-47a8-92b0-6d421bb258a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:48.762889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b8191a5-8046-47a8-92b0-6d421bb258a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:48.763707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b8191a5-8046-47a8-92b0-6d421bb258a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:48.764164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b8191a5-8046-47a8-92b0-6d421bb258a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:48.795776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4b8191a5-8046-47a8-92b0-6d421bb258a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Jan 19 16:29:48.796272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 443/767] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:48.812005 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bf55920a-38ea-4b22-96a5-180853de671a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:48.813003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bf55920a-38ea-4b22-96a5-180853de671a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:48.819203 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf55920a-38ea-4b22-96a5-180853de671a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:48.819656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf55920a-38ea-4b22-96a5-180853de671a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:48.820471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf55920a-38ea-4b22-96a5-180853de671a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:48.820911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf55920a-38ea-4b22-96a5-180853de671a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:48.850399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bf55920a-38ea-4b22-96a5-180853de671a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 Jan 19 16:29:48.850970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 325/768] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:48.857531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:48.858148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:48.864162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:48.865287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:48.866079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:48.866520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:48.994650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:49.002791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:49.004353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:49.005578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ce58e4d-05f3-4075-8e45-1aa7c5b0e8a0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151748 Jan 19 16:29:49.006147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 444/769] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:48 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:49.807416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f6530f44-bc84-4655-894b-f875f8609882 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:49.808324 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f6530f44-bc84-4655-894b-f875f8609882 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:49.814231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f6530f44-bc84-4655-894b-f875f8609882 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:49.814804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f6530f44-bc84-4655-894b-f875f8609882 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:49.815447 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f6530f44-bc84-4655-894b-f875f8609882 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:49.815915 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f6530f44-bc84-4655-894b-f875f8609882 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:49.845854 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f6530f44-bc84-4655-894b-f875f8609882 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Jan 19 16:29:49.846398 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 326/770] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:49.861811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-efba4560-4d3e-423b-9fc7-814c205f71b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:49.862880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-efba4560-4d3e-423b-9fc7-814c205f71b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:49.869725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efba4560-4d3e-423b-9fc7-814c205f71b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:49.870175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efba4560-4d3e-423b-9fc7-814c205f71b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:49.870958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efba4560-4d3e-423b-9fc7-814c205f71b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:49.871405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efba4560-4d3e-423b-9fc7-814c205f71b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:49.900021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-efba4560-4d3e-423b-9fc7-814c205f71b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041911 Jan 19 16:29:49.900580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 445/771] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:50.024242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:50.024884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:50.030980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:50.031435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:50.032275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:50.032719 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:50.171247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:50.180179 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:50.181683 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:50.182833 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2bd9ba08-0c81-4f2b-a971-73b2eb811a2b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162375 Jan 19 16:29:50.183389 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 327/772] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:50 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:50.857551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a8e5e1c7-6356-4b1e-b1b1-1cdb5ff2328e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:50.858369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a8e5e1c7-6356-4b1e-b1b1-1cdb5ff2328e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:50.864348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8e5e1c7-6356-4b1e-b1b1-1cdb5ff2328e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:50.864916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8e5e1c7-6356-4b1e-b1b1-1cdb5ff2328e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:50.865549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8e5e1c7-6356-4b1e-b1b1-1cdb5ff2328e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:50.865981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8e5e1c7-6356-4b1e-b1b1-1cdb5ff2328e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:50.893618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a8e5e1c7-6356-4b1e-b1b1-1cdb5ff2328e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040063 Jan 19 16:29:50.894166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 446/773] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:50.912212 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-300808e2-66d5-411c-b49b-b6b8d017dd1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:50.913122 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-300808e2-66d5-411c-b49b-b6b8d017dd1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:50.919293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300808e2-66d5-411c-b49b-b6b8d017dd1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:50.919825 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300808e2-66d5-411c-b49b-b6b8d017dd1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:50.920605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300808e2-66d5-411c-b49b-b6b8d017dd1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:50.921036 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300808e2-66d5-411c-b49b-b6b8d017dd1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:50.949054 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-300808e2-66d5-411c-b49b-b6b8d017dd1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Jan 19 16:29:50.949602 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 328/774] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:51.201408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:51.202064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:51.209814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:51.210306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:51.211100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:51.211536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:51.338555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:51.346688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:51.348219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:51.349370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a96e8d4d-9643-482b-b44b-77c5148da3c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151699 Jan 19 16:29:51.349975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 447/775] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:51 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:51.905718 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-db296c50-5355-43ae-8d1f-a47808954b78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:51.906549 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-db296c50-5355-43ae-8d1f-a47808954b78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:51.913173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db296c50-5355-43ae-8d1f-a47808954b78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:51.913794 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db296c50-5355-43ae-8d1f-a47808954b78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:51.914401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db296c50-5355-43ae-8d1f-a47808954b78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:51.914841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-db296c50-5355-43ae-8d1f-a47808954b78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:51.945467 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-db296c50-5355-43ae-8d1f-a47808954b78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Jan 19 16:29:51.946335 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 329/776] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:51.961101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b9255f2f-7303-4b54-bd2b-014c46a1a868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:51.962053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b9255f2f-7303-4b54-bd2b-014c46a1a868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:51.968620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9255f2f-7303-4b54-bd2b-014c46a1a868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:51.969080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9255f2f-7303-4b54-bd2b-014c46a1a868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:51.969879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9255f2f-7303-4b54-bd2b-014c46a1a868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:51.970419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9255f2f-7303-4b54-bd2b-014c46a1a868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:52.001773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b9255f2f-7303-4b54-bd2b-014c46a1a868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Jan 19 16:29:52.002433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 448/777] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:52.015836 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:29:52.016059 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:29:52.366990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:52.367600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:52.373693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:52.374152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:52.374935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:52.375378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:52.507971 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:52.516140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:52.517633 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:52.518776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-da57292c-6e63-4a3c-8c4d-3d12cc793e81 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155641 Jan 19 16:29:52.519725 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 330/778] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:52 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:53.013356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-33f14e3c-e6bd-46a0-b4b0-7eadae728e66 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:53.014353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-33f14e3c-e6bd-46a0-b4b0-7eadae728e66 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:53.020913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33f14e3c-e6bd-46a0-b4b0-7eadae728e66 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:53.021366 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33f14e3c-e6bd-46a0-b4b0-7eadae728e66 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:53.022163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33f14e3c-e6bd-46a0-b4b0-7eadae728e66 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:53.022723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33f14e3c-e6bd-46a0-b4b0-7eadae728e66 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:53.052412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-33f14e3c-e6bd-46a0-b4b0-7eadae728e66 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042112 Jan 19 16:29:53.052973 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 331/779] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:53.055134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bdde8e3f-e843-40c8-8091-09417ba556ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:53.056089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bdde8e3f-e843-40c8-8091-09417ba556ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:53.062112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdde8e3f-e843-40c8-8091-09417ba556ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:53.062599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdde8e3f-e843-40c8-8091-09417ba556ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:53.063417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdde8e3f-e843-40c8-8091-09417ba556ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:53.063904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bdde8e3f-e843-40c8-8091-09417ba556ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:53.092870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bdde8e3f-e843-40c8-8091-09417ba556ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137952 Jan 19 16:29:53.093437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 449/780] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:53.538303 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:53.538901 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:53.545085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:53.545530 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:53.546310 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:53.546741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:53.684708 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:53.693586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:53.695097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:53.696344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-91e3651d-f08a-4147-896a-d97ed197ed54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162553 Jan 19 16:29:53.696912 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 332/781] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:53 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:54.063756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-33126e38-dcb6-40de-ae0a-5f9c725b5be0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:54.064588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-33126e38-dcb6-40de-ae0a-5f9c725b5be0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:54.071286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33126e38-dcb6-40de-ae0a-5f9c725b5be0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:54.071792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33126e38-dcb6-40de-ae0a-5f9c725b5be0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:54.072578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33126e38-dcb6-40de-ae0a-5f9c725b5be0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:54.073021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33126e38-dcb6-40de-ae0a-5f9c725b5be0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:54.104635 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4762de1e-5527-4162-89c5-5c77255b3704 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:54.105584 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4762de1e-5527-4162-89c5-5c77255b3704 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:54.107765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-33126e38-dcb6-40de-ae0a-5f9c725b5be0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047761 Jan 19 16:29:54.108461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 450/782] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:54.111928 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4762de1e-5527-4162-89c5-5c77255b3704 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:54.112381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4762de1e-5527-4162-89c5-5c77255b3704 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:54.113160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4762de1e-5527-4162-89c5-5c77255b3704 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:54.113596 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4762de1e-5527-4162-89c5-5c77255b3704 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:54.142371 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4762de1e-5527-4162-89c5-5c77255b3704 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Jan 19 16:29:54.142922 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 333/783] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:54.716153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:54.716766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:54.722834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:54.723294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:54.724316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:54.724757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:54.898121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:54.906578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:54.908122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:54.909533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c522f50-2cdf-4048-a133-9d40202475f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.198303 Jan 19 16:29:54.910378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 451/784] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:54 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:55.120056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f29e31e8-a47f-429d-8e70-d96ab4a3b9a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:55.121000 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f29e31e8-a47f-429d-8e70-d96ab4a3b9a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:55.127580 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f29e31e8-a47f-429d-8e70-d96ab4a3b9a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:55.128064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f29e31e8-a47f-429d-8e70-d96ab4a3b9a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:55.128875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f29e31e8-a47f-429d-8e70-d96ab4a3b9a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:55.129294 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f29e31e8-a47f-429d-8e70-d96ab4a3b9a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:55.154281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bfc654d5-6e2f-477d-a5c0-6d664fe72f79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:55.155230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bfc654d5-6e2f-477d-a5c0-6d664fe72f79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:55.159851 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f29e31e8-a47f-429d-8e70-d96ab4a3b9a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Jan 19 16:29:55.160782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 334/785] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:55.162254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfc654d5-6e2f-477d-a5c0-6d664fe72f79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:55.162710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfc654d5-6e2f-477d-a5c0-6d664fe72f79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:55.163507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfc654d5-6e2f-477d-a5c0-6d664fe72f79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:55.163970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfc654d5-6e2f-477d-a5c0-6d664fe72f79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:55.194574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bfc654d5-6e2f-477d-a5c0-6d664fe72f79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Jan 19 16:29:55.195136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 452/786] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:55.931912 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:55.933110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:55.939700 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:55.940184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:55.940976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:55.941424 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:56.079232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:56.090174 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:56.091740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:56.099337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8a75c6cb-52ea-473b-b626-2833cfa9d54b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.167045 Jan 19 16:29:56.099337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 335/787] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:55 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:56.171343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b41d8e4c-5190-44f3-ad43-b4f2c4136254 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:56.172306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b41d8e4c-5190-44f3-ad43-b4f2c4136254 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:56.179648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b41d8e4c-5190-44f3-ad43-b4f2c4136254 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:56.180205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b41d8e4c-5190-44f3-ad43-b4f2c4136254 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:56.181055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b41d8e4c-5190-44f3-ad43-b4f2c4136254 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:56.181493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b41d8e4c-5190-44f3-ad43-b4f2c4136254 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:56.205932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5f488e93-04e3-46d8-a430-dd0ae553f715 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:56.206944 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5f488e93-04e3-46d8-a430-dd0ae553f715 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:56.214146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f488e93-04e3-46d8-a430-dd0ae553f715 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:56.214714 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f488e93-04e3-46d8-a430-dd0ae553f715 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:56.215517 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f488e93-04e3-46d8-a430-dd0ae553f715 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:56.215990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f488e93-04e3-46d8-a430-dd0ae553f715 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:56.217570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b41d8e4c-5190-44f3-ad43-b4f2c4136254 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049928 Jan 19 16:29:56.218284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 453/788] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:56.247237 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5f488e93-04e3-46d8-a430-dd0ae553f715 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Jan 19 16:29:56.247831 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 336/789] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:57.111760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:57.112404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:57.118328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:57.118806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:57.119575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:57.120047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:57.229200 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1f2e9601-7e85-42a6-ad09-5b17d93321fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:57.230137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1f2e9601-7e85-42a6-ad09-5b17d93321fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:57.236382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2e9601-7e85-42a6-ad09-5b17d93321fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:57.236830 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2e9601-7e85-42a6-ad09-5b17d93321fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:57.237601 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2e9601-7e85-42a6-ad09-5b17d93321fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:57.238033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2e9601-7e85-42a6-ad09-5b17d93321fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:57.248918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:57.258228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:57.259836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:57.260937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5cad03b0-af20-4a04-b4f6-634d2e8a6bb1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152884 Jan 19 16:29:57.261999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 454/790] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:57 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:29:57.266655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2feecba1-8d1a-490a-a693-974de6a19f0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:57.267592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2feecba1-8d1a-490a-a693-974de6a19f0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:57.275826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2feecba1-8d1a-490a-a693-974de6a19f0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:57.276035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1f2e9601-7e85-42a6-ad09-5b17d93321fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050283 Jan 19 16:29:57.276284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2feecba1-8d1a-490a-a693-974de6a19f0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:57.276425 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 337/791] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:57.277079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2feecba1-8d1a-490a-a693-974de6a19f0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:57.277515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2feecba1-8d1a-490a-a693-974de6a19f0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:57.306952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2feecba1-8d1a-490a-a693-974de6a19f0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Jan 19 16:29:57.307536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 455/792] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:58.280232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:58.280843 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:58.287574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1acc1f4d-7b45-4e44-8ed4-83f1dbe87929 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:58.288089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:58.288508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:58.288613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1acc1f4d-7b45-4e44-8ed4-83f1dbe87929 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:58.289291 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:58.289735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:58.294674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1acc1f4d-7b45-4e44-8ed4-83f1dbe87929 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:58.295129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1acc1f4d-7b45-4e44-8ed4-83f1dbe87929 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:58.295947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1acc1f4d-7b45-4e44-8ed4-83f1dbe87929 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:58.296396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1acc1f4d-7b45-4e44-8ed4-83f1dbe87929 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:58.326358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1acc1f4d-7b45-4e44-8ed4-83f1dbe87929 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 Jan 19 16:29:58.326927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 456/793] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:58.331393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9c956e66-1cc9-4ea6-8a40-f40e89291b18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:58.333501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9c956e66-1cc9-4ea6-8a40-f40e89291b18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:58.339155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c956e66-1cc9-4ea6-8a40-f40e89291b18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:58.339601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c956e66-1cc9-4ea6-8a40-f40e89291b18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:58.340417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c956e66-1cc9-4ea6-8a40-f40e89291b18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:58.340848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c956e66-1cc9-4ea6-8a40-f40e89291b18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:58.370826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9c956e66-1cc9-4ea6-8a40-f40e89291b18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 Jan 19 16:29:58.370980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 457/794] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:58.421736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:58.429965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:58.431451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:58.432633 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-02149e48-dd23-491f-8609-dc1b413eed45 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156105 Jan 19 16:29:58.433195 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 338/795] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:58 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:29:59.338233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-58c50207-5f96-4f66-b0b5-a45f991e97d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:59.339086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-58c50207-5f96-4f66-b0b5-a45f991e97d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:59.345636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c50207-5f96-4f66-b0b5-a45f991e97d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:59.346099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c50207-5f96-4f66-b0b5-a45f991e97d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:59.346887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c50207-5f96-4f66-b0b5-a45f991e97d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:59.347326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c50207-5f96-4f66-b0b5-a45f991e97d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:59.379466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-58c50207-5f96-4f66-b0b5-a45f991e97d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045077 Jan 19 16:29:59.380125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 458/796] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:29:59.382036 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cf84bf56-f25b-4a77-b99a-934b88558365 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:59.382960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cf84bf56-f25b-4a77-b99a-934b88558365 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:59.389328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf84bf56-f25b-4a77-b99a-934b88558365 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:59.389771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf84bf56-f25b-4a77-b99a-934b88558365 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:59.390551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf84bf56-f25b-4a77-b99a-934b88558365 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:59.390980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf84bf56-f25b-4a77-b99a-934b88558365 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:59.426825 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cf84bf56-f25b-4a77-b99a-934b88558365 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048544 Jan 19 16:29:59.428032 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 339/797] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:29:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:29:59.450304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:29:59.450978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:29:59.457113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:59.457565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:59.458409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:29:59.458845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:29:59.585471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:59.593845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:59.595252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:29:59.596428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2e86108d-cb20-4735-9712-a175991cbcc9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.149921 Jan 19 16:29:59.596995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 459/798] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:29:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:00.390615 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b6ab5f85-7420-4121-b6e4-62da650cbed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:00.391537 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b6ab5f85-7420-4121-b6e4-62da650cbed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:00.398440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f85-7420-4121-b6e4-62da650cbed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:00.398888 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f85-7420-4121-b6e4-62da650cbed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:00.399721 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f85-7420-4121-b6e4-62da650cbed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:00.400156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f85-7420-4121-b6e4-62da650cbed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:00.434793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b6ab5f85-7420-4121-b6e4-62da650cbed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047461 Jan 19 16:30:00.434793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 340/799] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:00.438375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4ec3db1-ca0c-48c9-bb13-d25a47ce5136 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:00.439307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4ec3db1-ca0c-48c9-bb13-d25a47ce5136 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:00.446451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ec3db1-ca0c-48c9-bb13-d25a47ce5136 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:00.446897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ec3db1-ca0c-48c9-bb13-d25a47ce5136 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:00.447697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ec3db1-ca0c-48c9-bb13-d25a47ce5136 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:00.448151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ec3db1-ca0c-48c9-bb13-d25a47ce5136 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:00.479602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4ec3db1-ca0c-48c9-bb13-d25a47ce5136 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Jan 19 16:30:00.480211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 460/800] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:00.615939 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:00.616483 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:00.622785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:00.623384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:00.624406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:00.625003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:00.756812 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:00.764920 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:00.766402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:00.767535 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f75e53fd-6d4a-4f7d-9a5d-996ee16a781b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156032 Jan 19 16:30:00.768130 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 341/801] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:00 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:01.448371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d67864ec-ec85-4074-a21c-a112911a43cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:01.449940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d67864ec-ec85-4074-a21c-a112911a43cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:01.456156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d67864ec-ec85-4074-a21c-a112911a43cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:01.456584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d67864ec-ec85-4074-a21c-a112911a43cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:01.457362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d67864ec-ec85-4074-a21c-a112911a43cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:01.457795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d67864ec-ec85-4074-a21c-a112911a43cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:01.491586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d67864ec-ec85-4074-a21c-a112911a43cf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047021 Jan 19 16:30:01.491902 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4c3899b2-6c93-4276-bebd-ec8b3772584f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:01.492412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 461/802] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:01.493174 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4c3899b2-6c93-4276-bebd-ec8b3772584f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:01.501284 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c3899b2-6c93-4276-bebd-ec8b3772584f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:01.501729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c3899b2-6c93-4276-bebd-ec8b3772584f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:01.502547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c3899b2-6c93-4276-bebd-ec8b3772584f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:01.502978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4c3899b2-6c93-4276-bebd-ec8b3772584f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:01.532531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4c3899b2-6c93-4276-bebd-ec8b3772584f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Jan 19 16:30:01.533088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 342/803] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:01 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:01.786125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:01.786649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:01.793129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:01.793584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:01.794365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:01.794807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:01.942222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:01.951756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:01.954831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:01.956223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b334f1bf-6e0d-4acc-8f42-62f2fc4e4c7e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.174296 Jan 19 16:30:01.968578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 462/804] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:02.502349 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-82400adf-e5f1-4955-9aa7-b59166d4d8b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:02.503266 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-82400adf-e5f1-4955-9aa7-b59166d4d8b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:02.511273 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82400adf-e5f1-4955-9aa7-b59166d4d8b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:02.511758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82400adf-e5f1-4955-9aa7-b59166d4d8b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:02.512559 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82400adf-e5f1-4955-9aa7-b59166d4d8b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:02.513038 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82400adf-e5f1-4955-9aa7-b59166d4d8b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:02.543596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9f5eab61-d10d-436c-b251-d634b043b5f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:02.544291 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-82400adf-e5f1-4955-9aa7-b59166d4d8b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Jan 19 16:30:02.544550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9f5eab61-d10d-436c-b251-d634b043b5f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:02.544865 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 343/805] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:02.551016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f5eab61-d10d-436c-b251-d634b043b5f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:02.551466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f5eab61-d10d-436c-b251-d634b043b5f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:02.552294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f5eab61-d10d-436c-b251-d634b043b5f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:02.552772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f5eab61-d10d-436c-b251-d634b043b5f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:02.582883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9f5eab61-d10d-436c-b251-d634b043b5f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Jan 19 16:30:02.583438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 463/806] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:02.974223 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:02.975494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:02.981627 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:02.981984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:02.982767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:02.983206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:03.123830 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:03.132933 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:03.134421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:03.135573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0540699c-0764-4037-b3b5-355aea6eaddb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165099 Jan 19 16:30:03.136209 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 344/807] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:02 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:03.556499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-511c9c38-e4cf-4f65-91b3-f93c96c2ace6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:03.557330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-511c9c38-e4cf-4f65-91b3-f93c96c2ace6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:03.563807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511c9c38-e4cf-4f65-91b3-f93c96c2ace6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:03.564265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511c9c38-e4cf-4f65-91b3-f93c96c2ace6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:03.565070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511c9c38-e4cf-4f65-91b3-f93c96c2ace6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:03.565510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511c9c38-e4cf-4f65-91b3-f93c96c2ace6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:03.594306 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9cd7528b-82cd-40b5-97df-e260d7ad4914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:03.595215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9cd7528b-82cd-40b5-97df-e260d7ad4914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:03.596338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-511c9c38-e4cf-4f65-91b3-f93c96c2ace6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Jan 19 16:30:03.596923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 464/808] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:03.601670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9cd7528b-82cd-40b5-97df-e260d7ad4914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:03.602122 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9cd7528b-82cd-40b5-97df-e260d7ad4914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:03.602906 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9cd7528b-82cd-40b5-97df-e260d7ad4914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:03.603337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9cd7528b-82cd-40b5-97df-e260d7ad4914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:03.633051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9cd7528b-82cd-40b5-97df-e260d7ad4914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 Jan 19 16:30:03.633603 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 345/809] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:04.153761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:04.154367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:04.160514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:04.160968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:04.161755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:04.162843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:04.297114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:04.306005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:04.307938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:04.309354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ac94e02b-6461-460e-aa72-3157e5efaa20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159317 Jan 19 16:30:04.310082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 465/810] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:04 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:04.608033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-edbeb862-7716-4ca1-b1a8-f5da9e6d0aa6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:04.608950 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-edbeb862-7716-4ca1-b1a8-f5da9e6d0aa6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:04.615337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edbeb862-7716-4ca1-b1a8-f5da9e6d0aa6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:04.615824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edbeb862-7716-4ca1-b1a8-f5da9e6d0aa6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:04.616617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edbeb862-7716-4ca1-b1a8-f5da9e6d0aa6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:04.617057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edbeb862-7716-4ca1-b1a8-f5da9e6d0aa6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:04.643657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8b4c9e6d-875a-4dae-b2e2-22f5850d153f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:04.644860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8b4c9e6d-875a-4dae-b2e2-22f5850d153f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:04.653824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-edbeb862-7716-4ca1-b1a8-f5da9e6d0aa6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049166 Jan 19 16:30:04.654794 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 346/811] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:04.655829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b4c9e6d-875a-4dae-b2e2-22f5850d153f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:04.656617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b4c9e6d-875a-4dae-b2e2-22f5850d153f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:04.658012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b4c9e6d-875a-4dae-b2e2-22f5850d153f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:04.659121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b4c9e6d-875a-4dae-b2e2-22f5850d153f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:04.689769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8b4c9e6d-875a-4dae-b2e2-22f5850d153f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Jan 19 16:30:04.690350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 466/812] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:05.329125 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:05.329796 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:05.340618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:05.340618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:05.340618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:05.340618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:05.481288 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:05.489659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:05.491146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:05.492336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-447a5b71-81ca-4d4c-8a51-60a0be5c53b2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.167808 Jan 19 16:30:05.492899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 347/813] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:05 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:05.667581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-78fef9af-1cd2-4751-9e9d-be4b4c9bdf9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:05.668452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-78fef9af-1cd2-4751-9e9d-be4b4c9bdf9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:05.674929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78fef9af-1cd2-4751-9e9d-be4b4c9bdf9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:05.675383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78fef9af-1cd2-4751-9e9d-be4b4c9bdf9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:05.676208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78fef9af-1cd2-4751-9e9d-be4b4c9bdf9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:05.676656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78fef9af-1cd2-4751-9e9d-be4b4c9bdf9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:05.701583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fec04ca3-c6f8-4961-a6b1-385177733392 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:05.702494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fec04ca3-c6f8-4961-a6b1-385177733392 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:05.708726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fec04ca3-c6f8-4961-a6b1-385177733392 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:05.708912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-78fef9af-1cd2-4751-9e9d-be4b4c9bdf9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Jan 19 16:30:05.709186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fec04ca3-c6f8-4961-a6b1-385177733392 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:05.709662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 467/814] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:05.709969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fec04ca3-c6f8-4961-a6b1-385177733392 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:05.710474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fec04ca3-c6f8-4961-a6b1-385177733392 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:05.741077 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fec04ca3-c6f8-4961-a6b1-385177733392 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Jan 19 16:30:05.741745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 348/815] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:06.511138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:06.511781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:06.518243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:06.518605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:06.519408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:06.519883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:06.665171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:06.674426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:06.675949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:06.677112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f223a103-c93f-413e-aeed-445bd4b5a245 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.170138 Jan 19 16:30:06.677686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 468/816] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:06 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:06.720959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1f2b1eda-28de-4521-88c1-0331a1681ed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:06.721889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1f2b1eda-28de-4521-88c1-0331a1681ed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:06.729211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2b1eda-28de-4521-88c1-0331a1681ed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:06.729670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2b1eda-28de-4521-88c1-0331a1681ed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:06.730458 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2b1eda-28de-4521-88c1-0331a1681ed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:06.730932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f2b1eda-28de-4521-88c1-0331a1681ed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:06.752519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c2994e7-612b-434c-aa23-22b168b3a123 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:06.753537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8c2994e7-612b-434c-aa23-22b168b3a123 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:06.760441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2994e7-612b-434c-aa23-22b168b3a123 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:06.760887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2994e7-612b-434c-aa23-22b168b3a123 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:06.761698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2994e7-612b-434c-aa23-22b168b3a123 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:06.762143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c2994e7-612b-434c-aa23-22b168b3a123 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:06.763443 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1f2b1eda-28de-4521-88c1-0331a1681ed1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Jan 19 16:30:06.764255 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 349/817] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:06.796077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8c2994e7-612b-434c-aa23-22b168b3a123 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 Jan 19 16:30:06.796559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 469/818] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:07.248131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:07.248627 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:07.254749 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.255202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.256669 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.257104 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.289959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Going to try to terminate instance {{(pid=116209) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:30:07.378882 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0a0829df-31e0-42c0-81f9-ee74c4aa341f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "DELETE /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 204 len: 0 microversion: 2.1 time: 0.134232 Jan 19 16:30:07.379801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 350/819] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:30:07 2022] DELETE /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:30:07.390227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:07.391063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:07.398410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.398993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.399972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.400567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.567296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:07.577315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be022c89-9a58-4a09-90b4-287023cb26ca tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1575 microversion: 2.1 time: 0.191635 Jan 19 16:30:07.577907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 470/820] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:07 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:07.697827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:07.698546 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:07.704513 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.704970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.705764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.706199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.776388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3bc29207-9b8b-4547-9694-47e96f5d2538 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:07.777487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3bc29207-9b8b-4547-9694-47e96f5d2538 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:07.783356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc29207-9b8b-4547-9694-47e96f5d2538 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.784121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc29207-9b8b-4547-9694-47e96f5d2538 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.784922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc29207-9b8b-4547-9694-47e96f5d2538 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.785364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc29207-9b8b-4547-9694-47e96f5d2538 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.817044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3bc29207-9b8b-4547-9694-47e96f5d2538 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Jan 19 16:30:07.817654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 471/821] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:07.822899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7a1b1356-7ce7-411f-91ed-91f77a3a02ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:07.823952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7a1b1356-7ce7-411f-91ed-91f77a3a02ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:07.829942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a1b1356-7ce7-411f-91ed-91f77a3a02ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.830424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a1b1356-7ce7-411f-91ed-91f77a3a02ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.831227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a1b1356-7ce7-411f-91ed-91f77a3a02ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:07.831694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a1b1356-7ce7-411f-91ed-91f77a3a02ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:07.849578 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:07.858782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:07.860321 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:07.861509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9b477e8d-25f4-41df-8b4b-2de8125b5144 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.168287 Jan 19 16:30:07.862048 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 351/822] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:07.863925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7a1b1356-7ce7-411f-91ed-91f77a3a02ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Jan 19 16:30:07.864509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 472/823] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:08.594489 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:08.595091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:08.601388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.601842 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.602613 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.603045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.734000 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:08.741817 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2e08561e-1234-4b95-93bc-d9f43c29c4ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1575 microversion: 2.1 time: 0.150914 Jan 19 16:30:08.742384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 352/824] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:08 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:08.830173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-84886a93-60a7-4776-aecc-bb66fcfa655a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:08.830998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-84886a93-60a7-4776-aecc-bb66fcfa655a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:08.837825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84886a93-60a7-4776-aecc-bb66fcfa655a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.838154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84886a93-60a7-4776-aecc-bb66fcfa655a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.839030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84886a93-60a7-4776-aecc-bb66fcfa655a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.839471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84886a93-60a7-4776-aecc-bb66fcfa655a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.870714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-84886a93-60a7-4776-aecc-bb66fcfa655a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Jan 19 16:30:08.871330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 473/825] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:08.879584 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c956085a-2938-410c-aebf-30d087924bd3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:08.880190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:08.880727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c956085a-2938-410c-aebf-30d087924bd3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:08.880876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:08.887769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.887994 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c956085a-2938-410c-aebf-30d087924bd3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.888224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.888375 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c956085a-2938-410c-aebf-30d087924bd3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.889023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.889168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c956085a-2938-410c-aebf-30d087924bd3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:08.889464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.889608 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c956085a-2938-410c-aebf-30d087924bd3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:08.923533 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c956085a-2938-410c-aebf-30d087924bd3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049337 Jan 19 16:30:08.924163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 353/826] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:09.112004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:09.121201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:09.122839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:09.123937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0aae2dfc-310b-433a-911c-534dae3e5446 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.247370 Jan 19 16:30:09.125364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 474/827] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:08 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:09.758990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:09.759595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:09.765972 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:09.766443 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:09.767218 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:09.767656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:09.882745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0af83fca-66f2-44c9-85e0-9aa023614308 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:09.883658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0af83fca-66f2-44c9-85e0-9aa023614308 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:09.890040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af83fca-66f2-44c9-85e0-9aa023614308 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:09.890497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af83fca-66f2-44c9-85e0-9aa023614308 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:09.891292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af83fca-66f2-44c9-85e0-9aa023614308 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:09.891758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af83fca-66f2-44c9-85e0-9aa023614308 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:09.933083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0af83fca-66f2-44c9-85e0-9aa023614308 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054538 Jan 19 16:30:09.933903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 475/828] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:09.939999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6c7e51e-8f98-4603-8c8a-bb1c2d6f78e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:09.941191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6c7e51e-8f98-4603-8c8a-bb1c2d6f78e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:09.948238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c7e51e-8f98-4603-8c8a-bb1c2d6f78e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:09.948699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c7e51e-8f98-4603-8c8a-bb1c2d6f78e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:09.949513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c7e51e-8f98-4603-8c8a-bb1c2d6f78e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:09.949955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c7e51e-8f98-4603-8c8a-bb1c2d6f78e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:09.982944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6c7e51e-8f98-4603-8c8a-bb1c2d6f78e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047845 Jan 19 16:30:09.984188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 476/829] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:10.053092 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:10.061420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-49711dc1-594c-4112-b468-380c48c18d7d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1575 microversion: 2.1 time: 0.306521 Jan 19 16:30:10.062295 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 354/830] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:09 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1575 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:10.142640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:10.143432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:10.150170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:10.150901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:10.151802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:10.152238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:10.374336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [req-4f3f5103-8a8b-4f22-b399-be74acd3bb1a req-785c93ca-7616-4d59-abb9-11411f14800c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805b0677-e780-415d-8ce6-ca4ec1a0817a", "name": "network-vif-deleted", "tag": "94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87"}]} {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:30:10.375873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:30:10.375873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: warnings.warn(msg) Jan 19 16:30:10.384921 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-4f3f5103-8a8b-4f22-b399-be74acd3bb1a req-785c93ca-7616-4d59-abb9-11411f14800c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:10.385591 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [req-4f3f5103-8a8b-4f22-b399-be74acd3bb1a req-785c93ca-7616-4d59-abb9-11411f14800c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:10.391018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:10.399094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.compute.server_external_events [req-4f3f5103-8a8b-4f22-b399-be74acd3bb1a req-785c93ca-7616-4d59-abb9-11411f14800c service nova] Creating event network-vif-deleted:94c9d3c1-a4f2-4d58-9dd7-48ab30c1fa87 for instance 805b0677-e780-415d-8ce6-ca4ec1a0817a on hv-cinder-78447 Jan 19 16:30:10.400613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:10.402558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:10.404607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-86acae46-3961-43ce-8f88-52eb8f920224 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.266118 Jan 19 16:30:10.404832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [req-4f3f5103-8a8b-4f22-b399-be74acd3bb1a req-785c93ca-7616-4d59-abb9-11411f14800c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123545 Jan 19 16:30:10.405932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 355/831] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:10.411044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 477/832] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:10 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:10.948337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-aa94f186-8bc5-48ff-82c0-8ce3f00e26de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:10.949637 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-aa94f186-8bc5-48ff-82c0-8ce3f00e26de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:10.956084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa94f186-8bc5-48ff-82c0-8ce3f00e26de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:10.956536 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa94f186-8bc5-48ff-82c0-8ce3f00e26de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:10.957325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa94f186-8bc5-48ff-82c0-8ce3f00e26de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:10.957763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aa94f186-8bc5-48ff-82c0-8ce3f00e26de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:10.990774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-aa94f186-8bc5-48ff-82c0-8ce3f00e26de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 Jan 19 16:30:10.991615 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 356/833] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:10.998891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8800962b-a79e-4270-8040-afab5e283233 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:11.001924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8800962b-a79e-4270-8040-afab5e283233 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:11.009597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8800962b-a79e-4270-8040-afab5e283233 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:11.010157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8800962b-a79e-4270-8040-afab5e283233 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:11.011063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8800962b-a79e-4270-8040-afab5e283233 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:11.011629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8800962b-a79e-4270-8040-afab5e283233 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:11.043802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8800962b-a79e-4270-8040-afab5e283233 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053012 Jan 19 16:30:11.044371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 478/834] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:11.078841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:11.079450 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:11.086277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:11.086939 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:11.087798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:11.088235 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:11.157064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:11.166788 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4176dfaa-1e37-4ef2-a4b5-019e29d18149 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.091554 Jan 19 16:30:11.167797 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 357/835] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:11 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:11.423365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:11.423915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:11.430757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:11.431529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:11.432630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:11.433107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:11.590133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:11.599321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:11.601011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:11.602358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-69d2e232-0e8d-4828-aa1f-3d6fec0b460b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.182886 Jan 19 16:30:11.603290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 479/836] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:11 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:12.003744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7389cb54-714b-493e-aff9-fe833e151ea9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:12.004842 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7389cb54-714b-493e-aff9-fe833e151ea9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:12.014357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7389cb54-714b-493e-aff9-fe833e151ea9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.015161 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7389cb54-714b-493e-aff9-fe833e151ea9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.016439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7389cb54-714b-493e-aff9-fe833e151ea9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.017230 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7389cb54-714b-493e-aff9-fe833e151ea9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.050855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7389cb54-714b-493e-aff9-fe833e151ea9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052277 Jan 19 16:30:12.054504 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 358/837] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:12.060734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c4576343-82b1-43fc-b1a4-be34c2bc7a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:12.062463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c4576343-82b1-43fc-b1a4-be34c2bc7a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:12.074600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4576343-82b1-43fc-b1a4-be34c2bc7a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.075064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4576343-82b1-43fc-b1a4-be34c2bc7a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.075926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4576343-82b1-43fc-b1a4-be34c2bc7a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.076603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4576343-82b1-43fc-b1a4-be34c2bc7a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.110453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c4576343-82b1-43fc-b1a4-be34c2bc7a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057275 Jan 19 16:30:12.111041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 480/838] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:12.185061 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:12.185826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:12.192649 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.193309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.194309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.194838 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.265381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:12.278566 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b104a93e-8c62-4c06-af26-dad0aed38f82 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.097321 Jan 19 16:30:12.279163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 359/839] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:12 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:12.623831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:12.624783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:12.636198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.636198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.636593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:12.636992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:12.797520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:12.814351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:12.817186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:12.819451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-77c687d2-349e-4d3d-bc44-402deaf1913e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.201056 Jan 19 16:30:12.821948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 481/840] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:13.064268 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5b2976c7-3ce9-46a7-8c9e-fc679483887a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:13.065569 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5b2976c7-3ce9-46a7-8c9e-fc679483887a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:13.074124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b2976c7-3ce9-46a7-8c9e-fc679483887a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.074567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b2976c7-3ce9-46a7-8c9e-fc679483887a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:13.075404 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b2976c7-3ce9-46a7-8c9e-fc679483887a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.075928 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b2976c7-3ce9-46a7-8c9e-fc679483887a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:13.109847 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5b2976c7-3ce9-46a7-8c9e-fc679483887a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050764 Jan 19 16:30:13.110464 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 360/841] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:13.122042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8159a88e-cd51-4116-903c-662f2d453855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:13.122976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8159a88e-cd51-4116-903c-662f2d453855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:13.129917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8159a88e-cd51-4116-903c-662f2d453855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.131012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8159a88e-cd51-4116-903c-662f2d453855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:13.131904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8159a88e-cd51-4116-903c-662f2d453855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.132348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8159a88e-cd51-4116-903c-662f2d453855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:13.167803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8159a88e-cd51-4116-903c-662f2d453855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049409 Jan 19 16:30:13.168789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 482/842] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:13.296926 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:13.297538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:13.305109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.305991 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:13.307097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.307513 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:13.385156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:13.394117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f7930f56-50f0-4404-a192-1e62068ae271 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.100710 Jan 19 16:30:13.394891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 361/843] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:13 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:13.841727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:13.842476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:13.848574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.849028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:13.850442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:13.850873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:14.005441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:14.015510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:14.017035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:14.018262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5afed279-f00c-4c9c-b926-9c4af58f37ad tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.180455 Jan 19 16:30:14.018826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 483/844] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:14.121362 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ef4035b0-be03-49af-9fc6-e28052e71849 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:14.124322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ef4035b0-be03-49af-9fc6-e28052e71849 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:14.133722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef4035b0-be03-49af-9fc6-e28052e71849 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:14.134181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef4035b0-be03-49af-9fc6-e28052e71849 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:14.134989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef4035b0-be03-49af-9fc6-e28052e71849 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:14.135598 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef4035b0-be03-49af-9fc6-e28052e71849 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:14.173202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ef4035b0-be03-49af-9fc6-e28052e71849 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055681 Jan 19 16:30:14.174033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 362/845] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:14.182859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-154d883b-8046-4dd4-8d13-5b9dcd2fec83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:14.184237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-154d883b-8046-4dd4-8d13-5b9dcd2fec83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:14.194156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154d883b-8046-4dd4-8d13-5b9dcd2fec83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:14.195019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154d883b-8046-4dd4-8d13-5b9dcd2fec83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:14.195857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154d883b-8046-4dd4-8d13-5b9dcd2fec83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:14.196296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154d883b-8046-4dd4-8d13-5b9dcd2fec83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:14.238582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-154d883b-8046-4dd4-8d13-5b9dcd2fec83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062029 Jan 19 16:30:14.239165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 484/846] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:14.415146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:14.415776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:14.421780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:14.422224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:14.423024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:14.423459 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:14.486291 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:14.494636 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-334c8a96-5142-4396-9f6a-6853132c94fc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083548 Jan 19 16:30:14.495228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 363/847] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:14 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:15.038403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:15.039017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:15.045405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.045906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.046718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.047161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.184979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:15.187471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dc3907d5-24b4-4726-aa0f-675849d76f95 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:15.188657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dc3907d5-24b4-4726-aa0f-675849d76f95 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:15.195750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:15.196044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc3907d5-24b4-4726-aa0f-675849d76f95 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.196531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc3907d5-24b4-4726-aa0f-675849d76f95 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.197285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:15.197405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc3907d5-24b4-4726-aa0f-675849d76f95 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.197748 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc3907d5-24b4-4726-aa0f-675849d76f95 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.198613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a589e0b8-7119-47db-bfb5-3d6fc5156c17 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163960 Jan 19 16:30:15.199179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 485/848] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:15 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:15.228787 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dc3907d5-24b4-4726-aa0f-675849d76f95 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Jan 19 16:30:15.229359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 364/849] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:15.250371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d69cfa3f-d603-49a9-b9ae-6c2725964f45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:15.251299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d69cfa3f-d603-49a9-b9ae-6c2725964f45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:15.258669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d69cfa3f-d603-49a9-b9ae-6c2725964f45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.259082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d69cfa3f-d603-49a9-b9ae-6c2725964f45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.260053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d69cfa3f-d603-49a9-b9ae-6c2725964f45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.260352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d69cfa3f-d603-49a9-b9ae-6c2725964f45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.294618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d69cfa3f-d603-49a9-b9ae-6c2725964f45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047876 Jan 19 16:30:15.295114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 486/850] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:15.510361 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:15.511067 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:15.517386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.517841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.518649 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:15.519091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:15.586020 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:15.600925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-293a1781-7621-43de-a792-8f2530268346 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.092788 Jan 19 16:30:15.601916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 365/851] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:15 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:16.218142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:16.218817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:16.225381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.225836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.226632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.227076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.241277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3704b45a-f564-40b3-b73a-ce0ca665d0bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:16.242541 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3704b45a-f564-40b3-b73a-ce0ca665d0bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:16.249893 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3704b45a-f564-40b3-b73a-ce0ca665d0bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.250439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3704b45a-f564-40b3-b73a-ce0ca665d0bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.251234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3704b45a-f564-40b3-b73a-ce0ca665d0bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.252421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3704b45a-f564-40b3-b73a-ce0ca665d0bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.285552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3704b45a-f564-40b3-b73a-ce0ca665d0bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048684 Jan 19 16:30:16.286238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 366/852] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:16.309559 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b85f102c-c457-4b4d-bc83-b5020d00ee52 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:16.310466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b85f102c-c457-4b4d-bc83-b5020d00ee52 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:16.321475 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b85f102c-c457-4b4d-bc83-b5020d00ee52 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.321918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b85f102c-c457-4b4d-bc83-b5020d00ee52 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.322705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b85f102c-c457-4b4d-bc83-b5020d00ee52 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.323157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b85f102c-c457-4b4d-bc83-b5020d00ee52 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.357279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b85f102c-c457-4b4d-bc83-b5020d00ee52 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051178 Jan 19 16:30:16.357950 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 367/853] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:16.391620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:16.400487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:16.402992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:16.404203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-148fe330-0ba3-42fc-bc98-946f38864f89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.189872 Jan 19 16:30:16.404775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 487/854] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:16.626340 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:16.626929 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:16.638945 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.639771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.640849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:16.641299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:16.706472 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:16.716300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c0e2ba2e-351f-4ef8-a4a0-bd3d4fb849a3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.093760 Jan 19 16:30:16.716898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 368/855] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:16 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:17.297483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c3e566e1-d511-4511-9f2e-6390d3d1b815 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:17.298461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c3e566e1-d511-4511-9f2e-6390d3d1b815 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:17.306179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3e566e1-d511-4511-9f2e-6390d3d1b815 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.306636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3e566e1-d511-4511-9f2e-6390d3d1b815 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.307551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3e566e1-d511-4511-9f2e-6390d3d1b815 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.308032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3e566e1-d511-4511-9f2e-6390d3d1b815 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.339331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c3e566e1-d511-4511-9f2e-6390d3d1b815 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Jan 19 16:30:17.339974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 488/856] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:17.369171 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-38ed48ee-50c8-4296-ba3b-a4a015c092ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:17.370345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-38ed48ee-50c8-4296-ba3b-a4a015c092ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:17.376784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38ed48ee-50c8-4296-ba3b-a4a015c092ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.377234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38ed48ee-50c8-4296-ba3b-a4a015c092ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.378173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38ed48ee-50c8-4296-ba3b-a4a015c092ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.378623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38ed48ee-50c8-4296-ba3b-a4a015c092ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.411802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-38ed48ee-50c8-4296-ba3b-a4a015c092ea tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Jan 19 16:30:17.412466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 369/857] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:17.422248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:17.422859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:17.433244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.433244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.433244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.433244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.570272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:17.578868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:17.580422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:17.581571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1656f155-1a42-4ed8-bde3-f4d5f41921ec tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163021 Jan 19 16:30:17.582133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 489/858] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:17 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:17.738154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:17.738839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:17.745416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.745865 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.746681 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:17.747117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:17.813014 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:17.821663 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-eb4b856a-e2a9-4ad3-98a8-1ca569c1cec0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087051 Jan 19 16:30:17.822154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 370/859] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:17 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:18.350530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-12eb4409-d252-4cc7-ba52-2ba1f44ba8dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:18.352105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-12eb4409-d252-4cc7-ba52-2ba1f44ba8dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:18.359472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12eb4409-d252-4cc7-ba52-2ba1f44ba8dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.359985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12eb4409-d252-4cc7-ba52-2ba1f44ba8dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.360761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12eb4409-d252-4cc7-ba52-2ba1f44ba8dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.361202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12eb4409-d252-4cc7-ba52-2ba1f44ba8dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.392181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-12eb4409-d252-4cc7-ba52-2ba1f44ba8dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Jan 19 16:30:18.392791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 490/860] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:18.425256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1fcaa64e-3f19-4d6d-b009-c3f8646b70bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:18.426173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1fcaa64e-3f19-4d6d-b009-c3f8646b70bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:18.433208 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fcaa64e-3f19-4d6d-b009-c3f8646b70bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.433663 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fcaa64e-3f19-4d6d-b009-c3f8646b70bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.434475 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fcaa64e-3f19-4d6d-b009-c3f8646b70bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.434915 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1fcaa64e-3f19-4d6d-b009-c3f8646b70bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.471618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1fcaa64e-3f19-4d6d-b009-c3f8646b70bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050008 Jan 19 16:30:18.472283 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 371/861] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:18.599932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:18.600459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:18.606976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.607433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.608254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.608728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.748101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:18.756477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:18.758566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:18.759731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9d27db01-12a0-4763-9a18-8c30e3f94e01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163561 Jan 19 16:30:18.760294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 491/862] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:18 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:18.846557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:18.847203 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:18.853775 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.854167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.854945 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:18.855387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:18.916212 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:18.923427 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e42521a7-cc5c-41ba-9be7-3030c133b66f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080511 Jan 19 16:30:18.924038 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 372/863] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:18 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:19.403989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ef8e1dc9-5476-4a62-a73a-2615854fc2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:19.404936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ef8e1dc9-5476-4a62-a73a-2615854fc2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:19.411584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef8e1dc9-5476-4a62-a73a-2615854fc2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.412069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef8e1dc9-5476-4a62-a73a-2615854fc2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:19.412860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef8e1dc9-5476-4a62-a73a-2615854fc2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.413919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef8e1dc9-5476-4a62-a73a-2615854fc2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:19.443276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ef8e1dc9-5476-4a62-a73a-2615854fc2f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Jan 19 16:30:19.443878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 492/864] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:19.482319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0a9fbca6-1902-4f23-bb89-a359a1e5dfe4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:19.483235 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0a9fbca6-1902-4f23-bb89-a359a1e5dfe4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:19.489581 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a9fbca6-1902-4f23-bb89-a359a1e5dfe4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.490040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a9fbca6-1902-4f23-bb89-a359a1e5dfe4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:19.490813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a9fbca6-1902-4f23-bb89-a359a1e5dfe4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.491253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a9fbca6-1902-4f23-bb89-a359a1e5dfe4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:19.520267 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0a9fbca6-1902-4f23-bb89-a359a1e5dfe4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 Jan 19 16:30:19.520818 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 373/865] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:19.777816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:19.778413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:19.784732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.785180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:19.785966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.786400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:19.923482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:19.932215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:19.933777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:19.934926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0c1a25d5-1f45-43ca-bb12-02a2ead51d72 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.160871 Jan 19 16:30:19.935494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 493/866] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:19.940726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:19.941340 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:19.947527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.948011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:19.948803 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:19.949380 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:20.010033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:20.017597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1a13d680-89b0-4275-aa41-ae2cdc6253f5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080417 Jan 19 16:30:20.018173 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 374/867] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:19 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:20.454833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e82d5eeb-2dc7-481e-9801-c01a0ec477c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:20.455775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e82d5eeb-2dc7-481e-9801-c01a0ec477c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:20.461780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e82d5eeb-2dc7-481e-9801-c01a0ec477c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:20.462230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e82d5eeb-2dc7-481e-9801-c01a0ec477c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:20.463018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e82d5eeb-2dc7-481e-9801-c01a0ec477c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:20.463460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e82d5eeb-2dc7-481e-9801-c01a0ec477c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:20.493992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e82d5eeb-2dc7-481e-9801-c01a0ec477c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Jan 19 16:30:20.494567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 494/868] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:20.533069 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-569703e1-3e64-4c07-9659-b7e9cf1737ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:20.534263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-569703e1-3e64-4c07-9659-b7e9cf1737ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:20.541363 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-569703e1-3e64-4c07-9659-b7e9cf1737ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:20.541810 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-569703e1-3e64-4c07-9659-b7e9cf1737ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:20.542599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-569703e1-3e64-4c07-9659-b7e9cf1737ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:20.543030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-569703e1-3e64-4c07-9659-b7e9cf1737ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:20.587339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-569703e1-3e64-4c07-9659-b7e9cf1737ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057791 Jan 19 16:30:20.588412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 375/869] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:20.953155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:20.953845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:20.960906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:20.961468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:20.962278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:20.962722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:21.035199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:21.035866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:21.041677 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:21.042127 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:21.043347 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:21.043347 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:21.115910 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:21.120364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:21.123736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d4ba2306-4895-4604-81a9-5bb088b75205 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.092330 Jan 19 16:30:21.124334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 376/870] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:21 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:21.129682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:21.131271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:21.133081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ac5a0c5-8fa9-4ff3-94f9-c156c3cc50b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.183714 Jan 19 16:30:21.133718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 495/871] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:20 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:21.505183 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-18c1dd22-0e87-4dda-a620-d8c4ca9e6358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:21.506121 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-18c1dd22-0e87-4dda-a620-d8c4ca9e6358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:21.512924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-18c1dd22-0e87-4dda-a620-d8c4ca9e6358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:21.513377 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-18c1dd22-0e87-4dda-a620-d8c4ca9e6358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:21.514229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-18c1dd22-0e87-4dda-a620-d8c4ca9e6358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:21.514671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-18c1dd22-0e87-4dda-a620-d8c4ca9e6358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:21.543832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-18c1dd22-0e87-4dda-a620-d8c4ca9e6358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Jan 19 16:30:21.544393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 377/872] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:21.599111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e146fd29-9042-43f5-b158-a808f95c1729 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:21.600083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e146fd29-9042-43f5-b158-a808f95c1729 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:21.606380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e146fd29-9042-43f5-b158-a808f95c1729 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:21.606839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e146fd29-9042-43f5-b158-a808f95c1729 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:21.607622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e146fd29-9042-43f5-b158-a808f95c1729 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:21.608093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e146fd29-9042-43f5-b158-a808f95c1729 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:21.637541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e146fd29-9042-43f5-b158-a808f95c1729 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042438 Jan 19 16:30:21.638118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 496/873] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:22.140714 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:22.141328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:22.147358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.147917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.148627 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.149067 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.151342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:22.152015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:22.157930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.158387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.159512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.159980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.216619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:22.224097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-09db7d97-d9c9-4710-8aab-b4aa34973621 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.086972 Jan 19 16:30:22.224667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 378/874] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:22 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:22.307258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:22.315521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:22.317044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:22.318228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2749a8b7-5fd1-495f-89f9-ced95d231eaa tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.170557 Jan 19 16:30:22.318791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 497/875] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:22 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:22.556176 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fa9c7c9e-1a7f-444c-b82e-fc492cdfdc05 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:22.556710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fa9c7c9e-1a7f-444c-b82e-fc492cdfdc05 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:22.563272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa9c7c9e-1a7f-444c-b82e-fc492cdfdc05 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.563723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa9c7c9e-1a7f-444c-b82e-fc492cdfdc05 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.564512 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa9c7c9e-1a7f-444c-b82e-fc492cdfdc05 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.564940 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fa9c7c9e-1a7f-444c-b82e-fc492cdfdc05 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.595088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fa9c7c9e-1a7f-444c-b82e-fc492cdfdc05 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Jan 19 16:30:22.595665 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 379/876] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:22.649254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-632218b7-1101-4a1d-b4af-78a0a033359e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:22.650221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-632218b7-1101-4a1d-b4af-78a0a033359e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:22.656965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632218b7-1101-4a1d-b4af-78a0a033359e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.657497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632218b7-1101-4a1d-b4af-78a0a033359e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.658321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632218b7-1101-4a1d-b4af-78a0a033359e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:22.659069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-632218b7-1101-4a1d-b4af-78a0a033359e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:22.692892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-632218b7-1101-4a1d-b4af-78a0a033359e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047457 Jan 19 16:30:22.693718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 498/877] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:23.240305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:23.240940 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:23.246986 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.247439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.248256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.248696 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.316503 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:23.324384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dcdd88ca-7a96-4fba-873f-082c0d548fe2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087714 Jan 19 16:30:23.324950 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 380/878] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:23 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:23.337427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:23.338024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:23.343949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.344399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.345162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.345595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.472517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:23.481132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:23.482634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:23.483824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6c6af030-fdc0-49cf-8d22-ab0bfa928711 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150661 Jan 19 16:30:23.484387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 499/879] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:23 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:23.606697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c77dd557-e9a6-40cf-a4c0-09072d9c6dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:23.607530 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c77dd557-e9a6-40cf-a4c0-09072d9c6dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:23.613858 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c77dd557-e9a6-40cf-a4c0-09072d9c6dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.614312 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c77dd557-e9a6-40cf-a4c0-09072d9c6dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.615088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c77dd557-e9a6-40cf-a4c0-09072d9c6dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.615529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c77dd557-e9a6-40cf-a4c0-09072d9c6dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.645925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c77dd557-e9a6-40cf-a4c0-09072d9c6dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043032 Jan 19 16:30:23.646692 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 381/880] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:23.704629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e5a7d9fe-e87d-4622-ada1-534a9813d69c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:23.705541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e5a7d9fe-e87d-4622-ada1-534a9813d69c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:23.711442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5a7d9fe-e87d-4622-ada1-534a9813d69c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.711939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5a7d9fe-e87d-4622-ada1-534a9813d69c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.712724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5a7d9fe-e87d-4622-ada1-534a9813d69c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:23.713166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5a7d9fe-e87d-4622-ada1-534a9813d69c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:23.741855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e5a7d9fe-e87d-4622-ada1-534a9813d69c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041481 Jan 19 16:30:23.742936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 500/881] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:24.341687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:24.342322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:24.348325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.348779 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.349567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.350004 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.408696 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:24.416963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d58f1f89-83a9-41b9-a98d-4a935853a7d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078884 Jan 19 16:30:24.417619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 382/882] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:24 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:24.501890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:24.502489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:24.508392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.508836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.509601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.510031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.640966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:24.650235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:24.651753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:24.652912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f79f7d9c-7512-4b97-b49f-b1afdd6ee579 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154715 Jan 19 16:30:24.654074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 501/883] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:24 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:24.657536 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b06c524d-c805-47e1-9b28-7b812485ab6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:24.658734 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b06c524d-c805-47e1-9b28-7b812485ab6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:24.665668 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b06c524d-c805-47e1-9b28-7b812485ab6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.666111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b06c524d-c805-47e1-9b28-7b812485ab6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.666883 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b06c524d-c805-47e1-9b28-7b812485ab6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.667316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b06c524d-c805-47e1-9b28-7b812485ab6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.700494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b06c524d-c805-47e1-9b28-7b812485ab6d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046759 Jan 19 16:30:24.701083 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 383/884] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:24.753720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dbf59017-57bf-4f90-8a2e-58d17c40b70a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:24.754676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dbf59017-57bf-4f90-8a2e-58d17c40b70a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:24.762002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf59017-57bf-4f90-8a2e-58d17c40b70a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.762458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf59017-57bf-4f90-8a2e-58d17c40b70a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.763263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf59017-57bf-4f90-8a2e-58d17c40b70a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:24.763735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf59017-57bf-4f90-8a2e-58d17c40b70a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:24.793042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dbf59017-57bf-4f90-8a2e-58d17c40b70a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Jan 19 16:30:24.793603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 502/885] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:25.434994 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:25.436198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:25.442719 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.443228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.444108 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.444600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.509272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:25.517047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3a7ef938-52bd-4a3b-8316-f5d85c74c14f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087074 Jan 19 16:30:25.517643 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 384/886] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:25 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:25.673208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:25.673828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:25.680654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.681105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.681906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.682352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.711785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0a05c5b1-acec-445d-858b-3e295f25e709 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:25.712905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0a05c5b1-acec-445d-858b-3e295f25e709 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:25.719582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a05c5b1-acec-445d-858b-3e295f25e709 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.720072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a05c5b1-acec-445d-858b-3e295f25e709 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.720872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a05c5b1-acec-445d-858b-3e295f25e709 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.721311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a05c5b1-acec-445d-858b-3e295f25e709 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.754017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0a05c5b1-acec-445d-858b-3e295f25e709 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Jan 19 16:30:25.754612 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 385/887] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:25.804228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-39f28644-6cb5-4583-9b25-556e51c63f02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:25.805206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-39f28644-6cb5-4583-9b25-556e51c63f02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:25.811138 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39f28644-6cb5-4583-9b25-556e51c63f02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.811587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39f28644-6cb5-4583-9b25-556e51c63f02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.812412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39f28644-6cb5-4583-9b25-556e51c63f02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:25.812845 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39f28644-6cb5-4583-9b25-556e51c63f02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:25.823081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:25.831832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:25.833333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:25.834493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9d00f810-3e8b-47ea-b87b-9e239688eb3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165135 Jan 19 16:30:25.835045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 503/888] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:25 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:25.844891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-39f28644-6cb5-4583-9b25-556e51c63f02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Jan 19 16:30:25.845476 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 386/889] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:26.535328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:26.535914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:26.543304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.543893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.545158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.545765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.613544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:26.621315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-74dab995-2216-40be-baaa-f921550bfc47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.089962 Jan 19 16:30:26.621886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 504/890] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:26 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:26.765745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dd8e8e94-f881-48d5-ab73-6db6ca535c3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:26.766671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dd8e8e94-f881-48d5-ab73-6db6ca535c3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:26.773798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dd8e8e94-f881-48d5-ab73-6db6ca535c3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.774258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dd8e8e94-f881-48d5-ab73-6db6ca535c3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.775058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dd8e8e94-f881-48d5-ab73-6db6ca535c3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.775499 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dd8e8e94-f881-48d5-ab73-6db6ca535c3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.807029 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dd8e8e94-f881-48d5-ab73-6db6ca535c3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045253 Jan 19 16:30:26.807616 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 387/891] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:26.853878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:26.854496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:26.856422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9de9b517-809f-4fe4-8bde-3f95af1471b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:26.857359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9de9b517-809f-4fe4-8bde-3f95af1471b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:26.861047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.861584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.862387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.862836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.867140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de9b517-809f-4fe4-8bde-3f95af1471b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.867588 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de9b517-809f-4fe4-8bde-3f95af1471b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.868398 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de9b517-809f-4fe4-8bde-3f95af1471b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:26.868833 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de9b517-809f-4fe4-8bde-3f95af1471b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:26.899650 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9de9b517-809f-4fe4-8bde-3f95af1471b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046776 Jan 19 16:30:26.900265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 388/892] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:27.015291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:27.025145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:27.026923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:27.028126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8d499552-c825-42dc-afbe-fae79746f313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.178769 Jan 19 16:30:27.028696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 505/893] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:26 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:27.638956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:27.639476 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:27.646263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:27.646717 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:27.647516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:27.648006 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:27.712211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:27.721694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1813d028-9042-4047-bdc7-ab7a201e23da tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.086265 Jan 19 16:30:27.722275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 389/894] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:27 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:27.818914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9a61bf47-6e53-454e-b353-7cf629fe69c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:27.819870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9a61bf47-6e53-454e-b353-7cf629fe69c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:27.825885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a61bf47-6e53-454e-b353-7cf629fe69c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:27.826333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a61bf47-6e53-454e-b353-7cf629fe69c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:27.827116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a61bf47-6e53-454e-b353-7cf629fe69c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:27.827541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a61bf47-6e53-454e-b353-7cf629fe69c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:27.859805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9a61bf47-6e53-454e-b353-7cf629fe69c8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Jan 19 16:30:27.860517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 506/895] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:27.911908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d145647a-b469-41c0-8744-c336379dbb7a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:27.912740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d145647a-b469-41c0-8744-c336379dbb7a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:27.919837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d145647a-b469-41c0-8744-c336379dbb7a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:27.920280 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d145647a-b469-41c0-8744-c336379dbb7a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:27.921072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d145647a-b469-41c0-8744-c336379dbb7a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:27.921500 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d145647a-b469-41c0-8744-c336379dbb7a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:27.951327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d145647a-b469-41c0-8744-c336379dbb7a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Jan 19 16:30:27.951926 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 390/896] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:28.046350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:28.046969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:28.053016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.053466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:28.054268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.054730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:28.190422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:28.198840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:28.200377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:28.201531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-69e4841e-e42f-4d57-af0c-4a415c9d0131 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158924 Jan 19 16:30:28.202096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 507/897] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:28 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:28.739894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:28.740511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:28.749248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.749694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:28.750494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.751070 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:28.858133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:28.867124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c88ea1f8-3b70-490f-b285-f9f43fb68ae5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.131504 Jan 19 16:30:28.873081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 391/898] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:28 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:28.875724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5546f25d-d814-42fe-8bc6-90876e4d726b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:28.877334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5546f25d-d814-42fe-8bc6-90876e4d726b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:28.888527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5546f25d-d814-42fe-8bc6-90876e4d726b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.889459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5546f25d-d814-42fe-8bc6-90876e4d726b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:28.891219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5546f25d-d814-42fe-8bc6-90876e4d726b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.891807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5546f25d-d814-42fe-8bc6-90876e4d726b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:28.957081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5546f25d-d814-42fe-8bc6-90876e4d726b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088926 Jan 19 16:30:28.958339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 508/899] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:28.964133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-60a8edb0-d297-47f4-b925-82cb5d85fbd6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:28.965846 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-60a8edb0-d297-47f4-b925-82cb5d85fbd6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:28.973322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-60a8edb0-d297-47f4-b925-82cb5d85fbd6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.973901 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-60a8edb0-d297-47f4-b925-82cb5d85fbd6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:28.974942 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-60a8edb0-d297-47f4-b925-82cb5d85fbd6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:28.975456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-60a8edb0-d297-47f4-b925-82cb5d85fbd6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:29.009845 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-60a8edb0-d297-47f4-b925-82cb5d85fbd6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050084 Jan 19 16:30:29.010900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 392/900] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:29.221649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:29.222220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:29.229150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:29.229608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:29.230529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:29.230852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:29.450953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:29.464199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:29.465706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:29.466963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7146cc00-7b5b-4059-9297-1ef67607080c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.249218 Jan 19 16:30:29.467549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 509/901] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:29 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:29.884416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:29.885297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:29.892113 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:29.892563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:29.893377 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:29.893824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:29.964984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:29.969837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-37cb96a8-0237-427d-9453-837fb28d4216 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:29.971858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-37cb96a8-0237-427d-9453-837fb28d4216 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:29.973412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-71085e20-c8c6-438b-8667-f141ab2f2f17 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.092870 Jan 19 16:30:29.974010 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 393/902] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:29 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:29.978887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37cb96a8-0237-427d-9453-837fb28d4216 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:29.979411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37cb96a8-0237-427d-9453-837fb28d4216 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:29.980470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37cb96a8-0237-427d-9453-837fb28d4216 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:29.981086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37cb96a8-0237-427d-9453-837fb28d4216 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:30.016537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-37cb96a8-0237-427d-9453-837fb28d4216 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050664 Jan 19 16:30:30.017137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 510/903] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:30.027890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-25a7ca2e-3014-446b-9ea5-79b3ce1667c3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:30.029364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-25a7ca2e-3014-446b-9ea5-79b3ce1667c3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:30.039607 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-25a7ca2e-3014-446b-9ea5-79b3ce1667c3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:30.040580 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-25a7ca2e-3014-446b-9ea5-79b3ce1667c3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:30.041624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-25a7ca2e-3014-446b-9ea5-79b3ce1667c3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:30.042335 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-25a7ca2e-3014-446b-9ea5-79b3ce1667c3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:30.090439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-25a7ca2e-3014-446b-9ea5-79b3ce1667c3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069080 Jan 19 16:30:30.091381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 394/904] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:30.486608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:30.487394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:30.496067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:30.496538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:30.497393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:30.498007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:30.703970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:30.716699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:30.718250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:30.720242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0e2127c4-6e41-4498-b1c3-958e8a35b36f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.237840 Jan 19 16:30:30.721162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 511/905] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:30 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:31.003387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:31.004596 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:31.016409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.017234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.018983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.019996 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.029554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-10db3ff3-b504-4df6-b3f2-841737ffe3ff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:31.030597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-10db3ff3-b504-4df6-b3f2-841737ffe3ff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:31.038193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10db3ff3-b504-4df6-b3f2-841737ffe3ff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.039469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10db3ff3-b504-4df6-b3f2-841737ffe3ff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.040581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10db3ff3-b504-4df6-b3f2-841737ffe3ff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.041243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10db3ff3-b504-4df6-b3f2-841737ffe3ff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.078939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-10db3ff3-b504-4df6-b3f2-841737ffe3ff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053545 Jan 19 16:30:31.079919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 512/906] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:31.105968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:31.108079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4108338f-ed2e-4c0d-9422-3ba0263ce672 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:31.109674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4108338f-ed2e-4c0d-9422-3ba0263ce672 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:31.120012 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1f072cde-c156-49fc-9344-35f43595e028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.123041 Jan 19 16:30:31.121053 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 395/907] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:30 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:31.122217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4108338f-ed2e-4c0d-9422-3ba0263ce672 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.123046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4108338f-ed2e-4c0d-9422-3ba0263ce672 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.124587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4108338f-ed2e-4c0d-9422-3ba0263ce672 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.125375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4108338f-ed2e-4c0d-9422-3ba0263ce672 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.186686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4108338f-ed2e-4c0d-9422-3ba0263ce672 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086097 Jan 19 16:30:31.187935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 513/908] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:31.750084 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:31.751293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:31.760735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.761334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.762199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:31.762678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:31.933128 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:31.942733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:31.944393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:31.946263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-36003a6c-0786-4ae6-9b67-2d69995941c0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.200643 Jan 19 16:30:31.946901 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 396/909] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:31 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:32.090405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ed1e24d7-4855-4840-b13f-c7987f6c6d49 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:32.092198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ed1e24d7-4855-4840-b13f-c7987f6c6d49 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:32.102063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed1e24d7-4855-4840-b13f-c7987f6c6d49 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.102574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed1e24d7-4855-4840-b13f-c7987f6c6d49 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:32.103438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed1e24d7-4855-4840-b13f-c7987f6c6d49 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.104036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed1e24d7-4855-4840-b13f-c7987f6c6d49 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:32.139193 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:32.140043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ed1e24d7-4855-4840-b13f-c7987f6c6d49 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052666 Jan 19 16:30:32.140205 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:32.140380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 514/910] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:32.148616 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.149074 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:32.149892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.150328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:32.205247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-53f82079-8c3a-4764-8bb9-3272cf2a25f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:32.206270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-53f82079-8c3a-4764-8bb9-3272cf2a25f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:32.217403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f82079-8c3a-4764-8bb9-3272cf2a25f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.218280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f82079-8c3a-4764-8bb9-3272cf2a25f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:32.219723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f82079-8c3a-4764-8bb9-3272cf2a25f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.220472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f82079-8c3a-4764-8bb9-3272cf2a25f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:32.254110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:32.267444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-53f82079-8c3a-4764-8bb9-3272cf2a25f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068378 Jan 19 16:30:32.268103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 515/911] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:32.268420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b99642c4-aaed-4390-b98c-2ca759ab2836 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.132549 Jan 19 16:30:32.269846 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 397/912] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:32 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:30:32.965157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:32.965776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:32.972981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.973441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:32.974249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:32.974855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:33.153754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a3793f7d-140e-4853-beba-5733e30f851b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:33.154923 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a3793f7d-140e-4853-beba-5733e30f851b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:33.158865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:33.164604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a3793f7d-140e-4853-beba-5733e30f851b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:33.165382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a3793f7d-140e-4853-beba-5733e30f851b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:33.166379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a3793f7d-140e-4853-beba-5733e30f851b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:33.167131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a3793f7d-140e-4853-beba-5733e30f851b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:33.168328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:33.169847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:33.171657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f3cf7d7d-1ba2-4e61-8fa6-2696890776c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.210127 Jan 19 16:30:33.173573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 516/913] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:32 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:33.207519 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a3793f7d-140e-4853-beba-5733e30f851b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058945 Jan 19 16:30:33.208976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 398/914] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:33.286615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6a41e2d7-f032-4f3c-9f1f-d9efc10f17e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:33.288046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6a41e2d7-f032-4f3c-9f1f-d9efc10f17e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:33.290499 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:33.291529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:33.298565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a41e2d7-f032-4f3c-9f1f-d9efc10f17e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:33.299301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a41e2d7-f032-4f3c-9f1f-d9efc10f17e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:33.300912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a41e2d7-f032-4f3c-9f1f-d9efc10f17e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:33.301661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a41e2d7-f032-4f3c-9f1f-d9efc10f17e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:33.302692 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:33.303518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:33.304889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:33.305600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:33.352305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6a41e2d7-f032-4f3c-9f1f-d9efc10f17e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071855 Jan 19 16:30:33.353272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 517/915] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:33.380252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:33.388397 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-11a867e0-6b3d-499a-a6c6-a2327ec58339 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.104781 Jan 19 16:30:33.389123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 399/916] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:33 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:34.192153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:34.192749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:34.200276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.200693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.201486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.201925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.220265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-642d1cb0-5ca2-4158-ac89-e3db91711070 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:34.221213 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-642d1cb0-5ca2-4158-ac89-e3db91711070 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:34.228551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-642d1cb0-5ca2-4158-ac89-e3db91711070 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.229006 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-642d1cb0-5ca2-4158-ac89-e3db91711070 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.229806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-642d1cb0-5ca2-4158-ac89-e3db91711070 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.230352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-642d1cb0-5ca2-4158-ac89-e3db91711070 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.264081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-642d1cb0-5ca2-4158-ac89-e3db91711070 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047689 Jan 19 16:30:34.265528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 400/917] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:34.351933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:34.366172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3a08fadd-d8af-4e5e-85c2-d1020a0a52f7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:34.366401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:34.367407 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3a08fadd-d8af-4e5e-85c2-d1020a0a52f7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:34.368047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:34.370044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d956c3fb-350c-4072-a4c5-f7dba06adde8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.182037 Jan 19 16:30:34.370626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 518/918] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:34 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:34.375461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a08fadd-d8af-4e5e-85c2-d1020a0a52f7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.376185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a08fadd-d8af-4e5e-85c2-d1020a0a52f7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.377957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a08fadd-d8af-4e5e-85c2-d1020a0a52f7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.377957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3a08fadd-d8af-4e5e-85c2-d1020a0a52f7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.411319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3a08fadd-d8af-4e5e-85c2-d1020a0a52f7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049633 Jan 19 16:30:34.412047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 401/919] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:34.415771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:34.421854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:34.428428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.428877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.429782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:34.430154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:34.498116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:34.506093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-474a4805-7130-40d5-bc5e-2874bd4233fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.095796 Jan 19 16:30:34.507928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 519/920] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:34 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:30:35.276426 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ee1a52af-2223-4941-96ef-0ecc0cb5d1cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:35.277439 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ee1a52af-2223-4941-96ef-0ecc0cb5d1cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:35.285802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee1a52af-2223-4941-96ef-0ecc0cb5d1cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.286727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee1a52af-2223-4941-96ef-0ecc0cb5d1cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.288524 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee1a52af-2223-4941-96ef-0ecc0cb5d1cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.290156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ee1a52af-2223-4941-96ef-0ecc0cb5d1cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.329126 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ee1a52af-2223-4941-96ef-0ecc0cb5d1cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056547 Jan 19 16:30:35.329726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 402/921] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:35.389264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:35.390365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:35.400121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.400596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.401684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.402625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.422738 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a9f8a880-b8b6-413f-a4fa-635c5d5a7643 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:35.424052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a9f8a880-b8b6-413f-a4fa-635c5d5a7643 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:35.433358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9f8a880-b8b6-413f-a4fa-635c5d5a7643 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.434163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9f8a880-b8b6-413f-a4fa-635c5d5a7643 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.435574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9f8a880-b8b6-413f-a4fa-635c5d5a7643 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.436599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9f8a880-b8b6-413f-a4fa-635c5d5a7643 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.483667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a9f8a880-b8b6-413f-a4fa-635c5d5a7643 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064357 Jan 19 16:30:35.484736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 403/922] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:35.525396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:35.526063 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:35.538325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.539435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.540560 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:35.541007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:35.745438 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:35.753607 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ea5c69b9-f96a-42bb-bf22-05aa51f73028 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.232840 Jan 19 16:30:35.754212 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 404/923] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:35 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:35.827312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:35.837035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:35.838577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:35.839980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7612b813-663b-4b46-93c2-776982a15905 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.454639 Jan 19 16:30:35.840902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 520/924] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:35 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:36.342839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9e2593c6-2f9d-4388-bb8b-2173066d2296 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:36.343751 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9e2593c6-2f9d-4388-bb8b-2173066d2296 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:36.355760 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9e2593c6-2f9d-4388-bb8b-2173066d2296 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.358421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9e2593c6-2f9d-4388-bb8b-2173066d2296 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:36.362405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9e2593c6-2f9d-4388-bb8b-2173066d2296 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.363204 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9e2593c6-2f9d-4388-bb8b-2173066d2296 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:36.419565 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9e2593c6-2f9d-4388-bb8b-2173066d2296 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080515 Jan 19 16:30:36.420562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 405/925] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:36.497784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4ccb7f3b-d2a3-45fc-a554-7fd6bf81871d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:36.499125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4ccb7f3b-d2a3-45fc-a554-7fd6bf81871d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:36.508562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ccb7f3b-d2a3-45fc-a554-7fd6bf81871d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.509053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ccb7f3b-d2a3-45fc-a554-7fd6bf81871d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:36.510008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ccb7f3b-d2a3-45fc-a554-7fd6bf81871d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.510589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ccb7f3b-d2a3-45fc-a554-7fd6bf81871d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:36.550707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4ccb7f3b-d2a3-45fc-a554-7fd6bf81871d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057443 Jan 19 16:30:36.551599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 521/926] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:36.772797 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:36.773415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:36.779888 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.780355 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:36.781158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.781610 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:36.845747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:36.854530 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fdd8998b-2b19-4986-9e57-6196efcc9df9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085412 Jan 19 16:30:36.855118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 406/927] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:36 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:30:36.863487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:36.864018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:36.873041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.873041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:36.875424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:36.875424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:37.214920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:37.229683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:37.232447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:37.234511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d05a81b0-20ce-423a-89c7-a756ba4a9b37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.378184 Jan 19 16:30:37.235343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 522/928] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:36 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:37.439012 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3ea36306-b71e-4a9b-bd2c-a803d563fd67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:37.440693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3ea36306-b71e-4a9b-bd2c-a803d563fd67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:37.452346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ea36306-b71e-4a9b-bd2c-a803d563fd67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:37.453116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ea36306-b71e-4a9b-bd2c-a803d563fd67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:37.454653 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ea36306-b71e-4a9b-bd2c-a803d563fd67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:37.455462 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ea36306-b71e-4a9b-bd2c-a803d563fd67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:37.500638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3ea36306-b71e-4a9b-bd2c-a803d563fd67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068996 Jan 19 16:30:37.501223 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 407/929] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:37.565778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-43cdadf5-ea9a-4fc1-9661-db2ece97217a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:37.567209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-43cdadf5-ea9a-4fc1-9661-db2ece97217a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:37.578282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43cdadf5-ea9a-4fc1-9661-db2ece97217a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:37.579040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43cdadf5-ea9a-4fc1-9661-db2ece97217a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:37.580338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43cdadf5-ea9a-4fc1-9661-db2ece97217a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:37.581092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43cdadf5-ea9a-4fc1-9661-db2ece97217a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:37.623013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-43cdadf5-ea9a-4fc1-9661-db2ece97217a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063286 Jan 19 16:30:37.623597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 523/930] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:37.871744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:37.872348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:37.878953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:37.879395 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:37.880227 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:37.880654 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:37.946378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:37.959639 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dc20d808-823d-457a-a70f-913cb3f80e7b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.091196 Jan 19 16:30:37.960747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 408/931] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:37 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:38.256732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:38.257466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:38.263976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.264427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:38.265239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.265680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:38.412116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:38.421635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:38.423110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:38.424323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eb3fc4ac-df00-479c-8d64-f496d32a8586 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.172097 Jan 19 16:30:38.424862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 524/932] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:38 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:38.514599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fdd909fa-024e-4433-bbe3-7499366697ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:38.515494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fdd909fa-024e-4433-bbe3-7499366697ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:38.522749 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd909fa-024e-4433-bbe3-7499366697ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.523782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd909fa-024e-4433-bbe3-7499366697ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:38.524639 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd909fa-024e-4433-bbe3-7499366697ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.525074 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fdd909fa-024e-4433-bbe3-7499366697ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:38.558780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fdd909fa-024e-4433-bbe3-7499366697ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Jan 19 16:30:38.559376 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 409/933] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:38.635305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fb72a53f-45df-4289-85d6-f5a7385feaa5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:38.636327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fb72a53f-45df-4289-85d6-f5a7385feaa5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:38.644575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb72a53f-45df-4289-85d6-f5a7385feaa5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.645104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb72a53f-45df-4289-85d6-f5a7385feaa5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:38.646426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb72a53f-45df-4289-85d6-f5a7385feaa5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.647116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb72a53f-45df-4289-85d6-f5a7385feaa5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:38.684871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fb72a53f-45df-4289-85d6-f5a7385feaa5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053905 Jan 19 16:30:38.685702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 525/934] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:38.978338 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:38.979052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:38.985044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.985508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:38.986292 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:38.986730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:39.049244 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:39.057621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d57cb0ac-f3e0-46b4-8563-ac14d3e25133 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.084074 Jan 19 16:30:39.058207 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 410/935] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:38 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:39.442299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:39.442910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:39.448836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:39.449292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:39.450072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:39.450511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:39.570914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-324479ed-d45d-4ae4-961e-3e06a4981872 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:39.572052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-324479ed-d45d-4ae4-961e-3e06a4981872 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:39.577463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:39.578232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-324479ed-d45d-4ae4-961e-3e06a4981872 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:39.578678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-324479ed-d45d-4ae4-961e-3e06a4981872 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:39.579456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-324479ed-d45d-4ae4-961e-3e06a4981872 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:39.579926 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-324479ed-d45d-4ae4-961e-3e06a4981872 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:39.586320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:39.587870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:39.589060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e16ce532-ac67-42ff-9048-162df957318d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150603 Jan 19 16:30:39.589624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 526/936] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:39 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:39.610899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-324479ed-d45d-4ae4-961e-3e06a4981872 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Jan 19 16:30:39.611466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 411/937] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:39.696746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-14d6eaab-b2c4-4b62-8f59-b0ae772d783e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:39.697666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-14d6eaab-b2c4-4b62-8f59-b0ae772d783e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:39.704139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14d6eaab-b2c4-4b62-8f59-b0ae772d783e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:39.704582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14d6eaab-b2c4-4b62-8f59-b0ae772d783e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:39.705381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14d6eaab-b2c4-4b62-8f59-b0ae772d783e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:39.705832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14d6eaab-b2c4-4b62-8f59-b0ae772d783e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:39.736969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-14d6eaab-b2c4-4b62-8f59-b0ae772d783e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Jan 19 16:30:39.737536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 527/938] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:40.074107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:40.074711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:40.080835 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.081281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.082065 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.082494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.144759 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:40.152568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-73c58117-718a-41e0-901a-36588b96e898 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082705 Jan 19 16:30:40.153154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 412/939] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:40 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:40.607532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:40.608161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:40.614155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.614601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.615383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.615846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.622827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4420ec1b-c74c-4c53-9e4a-162a4016ab28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:40.623898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4420ec1b-c74c-4c53-9e4a-162a4016ab28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:40.630510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4420ec1b-c74c-4c53-9e4a-162a4016ab28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.630975 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4420ec1b-c74c-4c53-9e4a-162a4016ab28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.631823 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4420ec1b-c74c-4c53-9e4a-162a4016ab28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.632274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4420ec1b-c74c-4c53-9e4a-162a4016ab28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.665802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4420ec1b-c74c-4c53-9e4a-162a4016ab28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046914 Jan 19 16:30:40.666592 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 413/940] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:40.748702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6d6ae5d5-0b2a-4eeb-8b7f-07e3f60fafc5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:40.749628 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6d6ae5d5-0b2a-4eeb-8b7f-07e3f60fafc5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:40.754554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:40.755853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d6ae5d5-0b2a-4eeb-8b7f-07e3f60fafc5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.756311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d6ae5d5-0b2a-4eeb-8b7f-07e3f60fafc5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.757168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d6ae5d5-0b2a-4eeb-8b7f-07e3f60fafc5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:40.758131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d6ae5d5-0b2a-4eeb-8b7f-07e3f60fafc5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:40.763575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:40.765110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:40.766271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4e7cd07-8820-4b7a-a9a2-faca4c06ee5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162546 Jan 19 16:30:40.766847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 528/941] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:40 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:40.791228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6d6ae5d5-0b2a-4eeb-8b7f-07e3f60fafc5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046312 Jan 19 16:30:40.791884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 414/942] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:41.170875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:41.171476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:41.177559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.178007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.178784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.179218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.237669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:41.245616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-08549182-4b72-47aa-ab99-fcd7072225e0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078340 Jan 19 16:30:41.246177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 529/943] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:41 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:41.677436 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f5f96141-e2fb-4729-aaab-98edade00868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:41.678361 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f5f96141-e2fb-4729-aaab-98edade00868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:41.684977 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5f96141-e2fb-4729-aaab-98edade00868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.685431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5f96141-e2fb-4729-aaab-98edade00868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.686223 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5f96141-e2fb-4729-aaab-98edade00868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.686670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f5f96141-e2fb-4729-aaab-98edade00868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.717103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f5f96141-e2fb-4729-aaab-98edade00868 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Jan 19 16:30:41.717674 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 415/944] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:41.795747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:41.796385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:41.802180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a400e275-6343-4d8e-bde5-e9bb98c5de27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:41.803092 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a400e275-6343-4d8e-bde5-e9bb98c5de27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:41.803223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.803644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.804470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.804948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.809320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a400e275-6343-4d8e-bde5-e9bb98c5de27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.809780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a400e275-6343-4d8e-bde5-e9bb98c5de27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.810558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a400e275-6343-4d8e-bde5-e9bb98c5de27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:41.810994 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a400e275-6343-4d8e-bde5-e9bb98c5de27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:41.841024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a400e275-6343-4d8e-bde5-e9bb98c5de27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042465 Jan 19 16:30:41.842590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 416/945] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:41.944804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:41.957915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:41.957915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:41.959103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-04763fe1-6603-4ba2-9873-d8d9939574c5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.167657 Jan 19 16:30:41.959657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 530/946] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:41 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:42.262823 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:42.263436 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:42.269553 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.270009 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:42.270816 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.271252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:42.336429 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:42.344235 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c73c8ea2-e88a-40b9-96a9-062bf3e89253 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085654 Jan 19 16:30:42.344827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 417/947] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:42 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:42.728604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5b5e2aa6-d7de-41c0-842d-e5c69a152d9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:42.730084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5b5e2aa6-d7de-41c0-842d-e5c69a152d9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:42.736165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b5e2aa6-d7de-41c0-842d-e5c69a152d9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.736622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b5e2aa6-d7de-41c0-842d-e5c69a152d9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:42.737406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b5e2aa6-d7de-41c0-842d-e5c69a152d9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.737844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b5e2aa6-d7de-41c0-842d-e5c69a152d9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:42.767705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5b5e2aa6-d7de-41c0-842d-e5c69a152d9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042795 Jan 19 16:30:42.768274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 531/948] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:42.853218 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-167cd7f1-dbd6-4b48-949b-b63d9afb26f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:42.854645 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-167cd7f1-dbd6-4b48-949b-b63d9afb26f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:42.861195 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-167cd7f1-dbd6-4b48-949b-b63d9afb26f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.861665 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-167cd7f1-dbd6-4b48-949b-b63d9afb26f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:42.862446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-167cd7f1-dbd6-4b48-949b-b63d9afb26f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.862890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-167cd7f1-dbd6-4b48-949b-b63d9afb26f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:42.892896 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-167cd7f1-dbd6-4b48-949b-b63d9afb26f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 Jan 19 16:30:42.893470 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 418/949] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:42.978342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:42.979597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:42.986369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.986837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:42.987639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:42.988105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:43.124516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:43.132913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:43.134382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:43.135516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c63aa44-c7aa-4281-901f-45a0674e7b62 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161072 Jan 19 16:30:43.136106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 532/950] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:42 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:43.363536 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:43.364617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:43.375269 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:43.376131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:43.377574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:43.378372 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:43.443657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:43.452022 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-129e15a9-0ba2-4ece-8822-dc86c7923586 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.094609 Jan 19 16:30:43.452605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 419/951] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:43 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:43.778577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1af49c87-07ec-4c89-9cbd-c252ce13cfde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:43.779507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1af49c87-07ec-4c89-9cbd-c252ce13cfde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:43.785866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1af49c87-07ec-4c89-9cbd-c252ce13cfde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:43.786323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1af49c87-07ec-4c89-9cbd-c252ce13cfde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:43.787108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1af49c87-07ec-4c89-9cbd-c252ce13cfde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:43.787549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1af49c87-07ec-4c89-9cbd-c252ce13cfde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:43.818277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1af49c87-07ec-4c89-9cbd-c252ce13cfde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 Jan 19 16:30:43.818864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 533/952] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:43.904716 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1cc31618-1d83-4e80-b4fa-ac9a2df150f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:43.905664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1cc31618-1d83-4e80-b4fa-ac9a2df150f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:43.912419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1cc31618-1d83-4e80-b4fa-ac9a2df150f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:43.912873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1cc31618-1d83-4e80-b4fa-ac9a2df150f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:43.913678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1cc31618-1d83-4e80-b4fa-ac9a2df150f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:43.914116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1cc31618-1d83-4e80-b4fa-ac9a2df150f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:43.945031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1cc31618-1d83-4e80-b4fa-ac9a2df150f8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Jan 19 16:30:43.945518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 420/953] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:44.154358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:44.155003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:44.161886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.162334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.163124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.163548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.301397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:44.310540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:44.312009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:44.313154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9327f797-ef31-40c8-9de0-00efe8b03eae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162610 Jan 19 16:30:44.313853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 534/954] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:44 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:44.469248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:44.469865 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:44.476044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.476499 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.477305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.477748 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.543459 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:44.551373 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-744c5b54-2c04-410d-a0d0-b7c4cbdec7e4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085880 Jan 19 16:30:44.551993 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 421/955] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:44 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:30:44.831725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d557ced-a4e8-4445-b924-17218d75b3b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:44.832568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d557ced-a4e8-4445-b924-17218d75b3b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:44.838903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d557ced-a4e8-4445-b924-17218d75b3b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.839985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d557ced-a4e8-4445-b924-17218d75b3b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.840791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d557ced-a4e8-4445-b924-17218d75b3b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.841235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d557ced-a4e8-4445-b924-17218d75b3b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.872541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d557ced-a4e8-4445-b924-17218d75b3b5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Jan 19 16:30:44.873134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 535/956] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:44.956826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8376c8fd-e5a0-45cb-9d8b-d7f9bd29a149 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:44.958104 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8376c8fd-e5a0-45cb-9d8b-d7f9bd29a149 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:44.965407 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8376c8fd-e5a0-45cb-9d8b-d7f9bd29a149 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.965865 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8376c8fd-e5a0-45cb-9d8b-d7f9bd29a149 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.966667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8376c8fd-e5a0-45cb-9d8b-d7f9bd29a149 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:44.967111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8376c8fd-e5a0-45cb-9d8b-d7f9bd29a149 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:44.998098 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8376c8fd-e5a0-45cb-9d8b-d7f9bd29a149 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Jan 19 16:30:44.998684 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 422/957] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:45.334186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:45.335256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:45.342069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:45.342706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:45.343812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:45.344256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:45.492806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:45.505386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:45.506880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:45.508119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-286e08f1-037f-4aa0-b587-2b6bb67da197 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.180149 Jan 19 16:30:45.508705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 536/958] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:45 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:45.569827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:45.570598 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:45.577255 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:45.577706 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:45.578526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:45.578967 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:45.644752 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:45.657119 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-483583f8-fefe-4ef5-b9a5-72b53a7142a6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.092407 Jan 19 16:30:45.657727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 423/959] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:45 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:45.884341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eca8304c-fa26-462c-b3db-4eb0a5d0951f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:45.885285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eca8304c-fa26-462c-b3db-4eb0a5d0951f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:45.891547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eca8304c-fa26-462c-b3db-4eb0a5d0951f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:45.892024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eca8304c-fa26-462c-b3db-4eb0a5d0951f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:45.892809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eca8304c-fa26-462c-b3db-4eb0a5d0951f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:45.893239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eca8304c-fa26-462c-b3db-4eb0a5d0951f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:45.924492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eca8304c-fa26-462c-b3db-4eb0a5d0951f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Jan 19 16:30:45.924986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 537/960] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:46.009375 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-49ed4635-fe89-4709-8c26-06d47c1b4427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:46.010289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-49ed4635-fe89-4709-8c26-06d47c1b4427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:46.016842 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49ed4635-fe89-4709-8c26-06d47c1b4427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.017289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49ed4635-fe89-4709-8c26-06d47c1b4427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.018083 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49ed4635-fe89-4709-8c26-06d47c1b4427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.018511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-49ed4635-fe89-4709-8c26-06d47c1b4427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.050747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-49ed4635-fe89-4709-8c26-06d47c1b4427 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Jan 19 16:30:46.051328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 424/961] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:46.537461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:46.538268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:46.545556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.546050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.546907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.547496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.678244 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:46.679306 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:46.690316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.691086 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.692687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.693198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.699234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:46.707873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:46.709728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:46.711165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bca188d6-9f72-4df0-899b-f6e4ce5460b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.178047 Jan 19 16:30:46.711751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 538/962] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:46 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:46.773502 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:46.781635 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b49593bb-9153-402b-b6fe-31156d912501 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.110396 Jan 19 16:30:46.782300 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 425/963] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:46 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:46.936926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b16b6bba-4ca8-4c28-8f8e-623ff33024a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:46.938003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b16b6bba-4ca8-4c28-8f8e-623ff33024a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:46.944639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b16b6bba-4ca8-4c28-8f8e-623ff33024a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.945084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b16b6bba-4ca8-4c28-8f8e-623ff33024a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.945901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b16b6bba-4ca8-4c28-8f8e-623ff33024a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:46.946337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b16b6bba-4ca8-4c28-8f8e-623ff33024a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:46.979157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b16b6bba-4ca8-4c28-8f8e-623ff33024a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046784 Jan 19 16:30:46.979774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 539/964] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:47.062944 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-40fc5c2e-d120-4bba-9ce9-7ca4e3899d79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:47.063926 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-40fc5c2e-d120-4bba-9ce9-7ca4e3899d79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:47.070774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40fc5c2e-d120-4bba-9ce9-7ca4e3899d79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:47.071273 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40fc5c2e-d120-4bba-9ce9-7ca4e3899d79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:47.072181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40fc5c2e-d120-4bba-9ce9-7ca4e3899d79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:47.072738 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40fc5c2e-d120-4bba-9ce9-7ca4e3899d79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:47.108027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-40fc5c2e-d120-4bba-9ce9-7ca4e3899d79 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048765 Jan 19 16:30:47.108702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 426/965] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:47.738190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:47.738799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:47.745301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:47.745746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:47.746523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:47.746955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:47.802659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:47.804018 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:47.814247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:47.815053 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:47.816390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:47.816932 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:47.894256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:47.902522 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6724e892-fb43-417f-bfc1-4ae73dd69da9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.106231 Jan 19 16:30:47.903123 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 427/966] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:47 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:47.917829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:47.926383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:47.927890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:47.929045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b9f0c4df-f740-4b1a-a5f4-4239e916c947 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.194576 Jan 19 16:30:47.929660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 540/967] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:47 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:47.990982 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1e77e4ec-b960-48f4-8124-7dba0cdc688e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:47.992048 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1e77e4ec-b960-48f4-8124-7dba0cdc688e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:47.999012 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e77e4ec-b960-48f4-8124-7dba0cdc688e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:47.999466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e77e4ec-b960-48f4-8124-7dba0cdc688e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.000308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e77e4ec-b960-48f4-8124-7dba0cdc688e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:48.000746 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e77e4ec-b960-48f4-8124-7dba0cdc688e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.032511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1e77e4ec-b960-48f4-8124-7dba0cdc688e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Jan 19 16:30:48.033106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 428/968] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:48.120183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05d7b2d3-de7a-41d3-9582-36ee641f7dbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:48.121203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-05d7b2d3-de7a-41d3-9582-36ee641f7dbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:48.127487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d7b2d3-de7a-41d3-9582-36ee641f7dbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:48.127982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d7b2d3-de7a-41d3-9582-36ee641f7dbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.128805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d7b2d3-de7a-41d3-9582-36ee641f7dbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:48.129273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d7b2d3-de7a-41d3-9582-36ee641f7dbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.168203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-05d7b2d3-de7a-41d3-9582-36ee641f7dbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051918 Jan 19 16:30:48.168785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 541/969] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:48.919630 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:48.920405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:48.926665 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:48.927112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.927925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:48.928356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.946231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:48.946850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:48.953230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:48.953688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.954475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:48.954918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:48.994811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:49.002317 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2236dda1-2c1d-4340-a4df-4bc70ecf21a8 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087383 Jan 19 16:30:49.002893 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 429/970] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:48 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:49.044832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5b8337be-08ba-4138-b860-d546f1e4bb58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:49.045736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5b8337be-08ba-4138-b860-d546f1e4bb58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:49.051769 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b8337be-08ba-4138-b860-d546f1e4bb58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:49.052462 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b8337be-08ba-4138-b860-d546f1e4bb58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:49.053254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b8337be-08ba-4138-b860-d546f1e4bb58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:49.053685 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b8337be-08ba-4138-b860-d546f1e4bb58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:49.084141 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5b8337be-08ba-4138-b860-d546f1e4bb58 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Jan 19 16:30:49.084727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 430/971] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:49.094562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:49.103083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:49.105197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:49.106338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f63736a3-4775-4873-858f-c3036ab49fa4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163851 Jan 19 16:30:49.106880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 542/972] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:48 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:49.179451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1795aa28-7a7e-4597-85ec-07abb14657a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:49.180382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1795aa28-7a7e-4597-85ec-07abb14657a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:49.186611 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1795aa28-7a7e-4597-85ec-07abb14657a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:49.187058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1795aa28-7a7e-4597-85ec-07abb14657a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:49.187881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1795aa28-7a7e-4597-85ec-07abb14657a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:49.188311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1795aa28-7a7e-4597-85ec-07abb14657a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:49.225959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1795aa28-7a7e-4597-85ec-07abb14657a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050186 Jan 19 16:30:49.226535 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 431/973] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:50.018064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:50.018675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:50.025118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.025575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.026394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.026853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.085162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:50.092419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1a01925c-e9d7-4434-b6be-db3e252ff863 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077954 Jan 19 16:30:50.092975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 543/974] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:50 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:30:50.095870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7a747d9b-b4d5-4621-a6af-5ab96b0e4255 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:50.096826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7a747d9b-b4d5-4621-a6af-5ab96b0e4255 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:50.103111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7a747d9b-b4d5-4621-a6af-5ab96b0e4255 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.103572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7a747d9b-b4d5-4621-a6af-5ab96b0e4255 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.104402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7a747d9b-b4d5-4621-a6af-5ab96b0e4255 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.105400 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7a747d9b-b4d5-4621-a6af-5ab96b0e4255 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.125001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:50.125618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:50.131415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.131903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.132695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.133132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.136740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7a747d9b-b4d5-4621-a6af-5ab96b0e4255 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Jan 19 16:30:50.137621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 432/975] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:50.238279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bae38d3a-5a15-4070-9837-6d9b8fe1a3a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:50.239177 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bae38d3a-5a15-4070-9837-6d9b8fe1a3a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:50.244952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bae38d3a-5a15-4070-9837-6d9b8fe1a3a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.245999 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bae38d3a-5a15-4070-9837-6d9b8fe1a3a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.246774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bae38d3a-5a15-4070-9837-6d9b8fe1a3a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:50.247202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bae38d3a-5a15-4070-9837-6d9b8fe1a3a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:50.266248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:50.274460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:50.275666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bae38d3a-5a15-4070-9837-6d9b8fe1a3a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041165 Jan 19 16:30:50.275937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:50.276269 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 433/976] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:50.277138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e68f9a63-91a6-4ee9-9ad7-29778ae1f540 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155766 Jan 19 16:30:50.277677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 544/977] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:50 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:51.109448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:51.110075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:51.116777 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.117233 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.118033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.118477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.150141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dc22acb8-ccf3-44f6-9b32-6a36d47ea9b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:51.152817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dc22acb8-ccf3-44f6-9b32-6a36d47ea9b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:51.160608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc22acb8-ccf3-44f6-9b32-6a36d47ea9b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.161065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc22acb8-ccf3-44f6-9b32-6a36d47ea9b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.162083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc22acb8-ccf3-44f6-9b32-6a36d47ea9b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.162527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc22acb8-ccf3-44f6-9b32-6a36d47ea9b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.186655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:51.194705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dc8b3eb5-93fe-4549-9aab-d074e01f490a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.088866 Jan 19 16:30:51.195305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 434/978] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:51 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:51.201645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dc22acb8-ccf3-44f6-9b32-6a36d47ea9b9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056007 Jan 19 16:30:51.202663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 545/979] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:51.287422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3f393a72-d440-4be3-a497-9e66f0258b0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:51.288382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3f393a72-d440-4be3-a497-9e66f0258b0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:51.294956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f393a72-d440-4be3-a497-9e66f0258b0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.295305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:51.295455 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f393a72-d440-4be3-a497-9e66f0258b0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.295967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:51.296217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f393a72-d440-4be3-a497-9e66f0258b0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.296656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f393a72-d440-4be3-a497-9e66f0258b0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.303825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.304286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.305129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:51.305569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:51.328318 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3f393a72-d440-4be3-a497-9e66f0258b0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Jan 19 16:30:51.328898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 435/980] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:51.447463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:51.457560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:51.459328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:51.460656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-54bef79c-b591-43d3-be0d-b97e03f2e26a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.169022 Jan 19 16:30:51.461224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 546/981] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:51 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:52.212697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:52.213531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:52.218647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-688e05b9-1584-4c39-baf8-30e1e98f3755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:52.219585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-688e05b9-1584-4c39-baf8-30e1e98f3755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:52.220249 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.220705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.221511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.221948 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.225997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-688e05b9-1584-4c39-baf8-30e1e98f3755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.226459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-688e05b9-1584-4c39-baf8-30e1e98f3755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.227261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-688e05b9-1584-4c39-baf8-30e1e98f3755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.227722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-688e05b9-1584-4c39-baf8-30e1e98f3755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.259117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-688e05b9-1584-4c39-baf8-30e1e98f3755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049064 Jan 19 16:30:52.259719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 547/982] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:52.285958 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:52.294345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a9be1bc2-9ab3-4b4e-8ef4-97172f569e95 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085715 Jan 19 16:30:52.294938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 436/983] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:52 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:52.339942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8862bb52-39d9-40e0-89a3-e3caea50f7be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:52.340857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8862bb52-39d9-40e0-89a3-e3caea50f7be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:52.347017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8862bb52-39d9-40e0-89a3-e3caea50f7be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.347462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8862bb52-39d9-40e0-89a3-e3caea50f7be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.348274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8862bb52-39d9-40e0-89a3-e3caea50f7be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.348707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8862bb52-39d9-40e0-89a3-e3caea50f7be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.379631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8862bb52-39d9-40e0-89a3-e3caea50f7be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Jan 19 16:30:52.380218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 548/984] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:52.479111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:52.480240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:52.486281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.486733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.487518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:52.488112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:52.628811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:52.637976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:52.639479 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:52.640675 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-779fec1a-4583-4f40-bb8d-4e2a077bd310 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165472 Jan 19 16:30:52.641249 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 437/985] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:52 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:53.271489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-db9243d3-df06-4a03-8825-31d2dcae6330 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:53.272445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-db9243d3-df06-4a03-8825-31d2dcae6330 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:53.279784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db9243d3-df06-4a03-8825-31d2dcae6330 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.280381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db9243d3-df06-4a03-8825-31d2dcae6330 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.281291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db9243d3-df06-4a03-8825-31d2dcae6330 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.281859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db9243d3-df06-4a03-8825-31d2dcae6330 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.311559 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:53.312201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:53.313641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-db9243d3-df06-4a03-8825-31d2dcae6330 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Jan 19 16:30:53.314235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 549/986] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:53.318518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.318965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.319785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.320224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.382668 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:53.390933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-567c20e2-1842-4e15-a11c-9d097c626946 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:53.391311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fb29d35a-2d4e-4934-a433-2ee1ef9b9505 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083195 Jan 19 16:30:53.391935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 438/987] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:53 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:30:53.392140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-567c20e2-1842-4e15-a11c-9d097c626946 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:53.398740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-567c20e2-1842-4e15-a11c-9d097c626946 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.399199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-567c20e2-1842-4e15-a11c-9d097c626946 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.400045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-567c20e2-1842-4e15-a11c-9d097c626946 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.400489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-567c20e2-1842-4e15-a11c-9d097c626946 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.437252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-567c20e2-1842-4e15-a11c-9d097c626946 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050040 Jan 19 16:30:53.437841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 550/988] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:53.659567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:53.660109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:53.666301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.666761 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.667575 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:53.668087 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:53.811552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:53.826571 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:53.829647 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:53.831986 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-77ba9b51-acf6-4c2b-986a-64d59e3e333d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.176094 Jan 19 16:30:53.833036 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 439/989] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:53 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:54.325181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-657b8ca1-86cf-4187-930d-7ef48090d8e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:54.326095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-657b8ca1-86cf-4187-930d-7ef48090d8e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:54.332830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657b8ca1-86cf-4187-930d-7ef48090d8e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.333275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657b8ca1-86cf-4187-930d-7ef48090d8e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.334101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657b8ca1-86cf-4187-930d-7ef48090d8e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.334532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657b8ca1-86cf-4187-930d-7ef48090d8e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.367316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-657b8ca1-86cf-4187-930d-7ef48090d8e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046009 Jan 19 16:30:54.367931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 551/990] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:54.415026 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:54.415630 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:54.423275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.423761 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.424680 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.425136 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.450653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-adb5ede8-158d-4c06-aa42-60e598e1dea4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:54.452057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-adb5ede8-158d-4c06-aa42-60e598e1dea4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:54.460888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adb5ede8-158d-4c06-aa42-60e598e1dea4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.461514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adb5ede8-158d-4c06-aa42-60e598e1dea4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.462708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adb5ede8-158d-4c06-aa42-60e598e1dea4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.463289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adb5ede8-158d-4c06-aa42-60e598e1dea4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.497280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-adb5ede8-158d-4c06-aa42-60e598e1dea4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052689 Jan 19 16:30:54.497862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 552/991] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:54.504658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:54.512519 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-43f03810-ea84-4c84-a803-dfc007037a25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.101054 Jan 19 16:30:54.513106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 440/992] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:54 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:54.850707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:54.851339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:54.857516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.857970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.858772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:54.859211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:54.995878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:55.005442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:55.006946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:55.008147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2014a1a4-8a8d-4803-b841-809662195a70 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161171 Jan 19 16:30:55.008716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 553/993] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:54 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:55.378498 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1a9419cd-771f-4636-ab41-e4d184223be2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:55.379416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1a9419cd-771f-4636-ab41-e4d184223be2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:55.385590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a9419cd-771f-4636-ab41-e4d184223be2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:55.386048 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a9419cd-771f-4636-ab41-e4d184223be2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:55.386908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a9419cd-771f-4636-ab41-e4d184223be2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:55.387693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1a9419cd-771f-4636-ab41-e4d184223be2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:55.420352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1a9419cd-771f-4636-ab41-e4d184223be2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Jan 19 16:30:55.421053 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 441/994] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:55.509357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-58cd1bec-5b72-49bd-ba5a-28d07f6d6cda tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:55.510292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-58cd1bec-5b72-49bd-ba5a-28d07f6d6cda tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:55.516915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58cd1bec-5b72-49bd-ba5a-28d07f6d6cda tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:55.517367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58cd1bec-5b72-49bd-ba5a-28d07f6d6cda tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:55.518169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58cd1bec-5b72-49bd-ba5a-28d07f6d6cda tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:55.518608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58cd1bec-5b72-49bd-ba5a-28d07f6d6cda tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:55.530290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:55.531060 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:55.539103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:55.539561 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:55.540423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:55.540865 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:55.552005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-58cd1bec-5b72-49bd-ba5a-28d07f6d6cda tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046501 Jan 19 16:30:55.552585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 554/995] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:55.609556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:55.617912 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3dcc2e0d-0ea0-4ffc-9e04-e46fe063d8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.091965 Jan 19 16:30:55.618514 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 442/996] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:55 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:30:56.027038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:56.027722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:56.034262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.034717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.035523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.036003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.180196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:56.189286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:56.190807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:56.192067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40c9adc6-f3f5-482b-8db3-80eec725b9c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.169348 Jan 19 16:30:56.192653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 555/997] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:56 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:56.432156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dba0f340-870b-4a07-9dc2-65e4b5cd1a73 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:56.433680 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dba0f340-870b-4a07-9dc2-65e4b5cd1a73 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:56.440953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dba0f340-870b-4a07-9dc2-65e4b5cd1a73 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.441400 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dba0f340-870b-4a07-9dc2-65e4b5cd1a73 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.442200 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dba0f340-870b-4a07-9dc2-65e4b5cd1a73 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.442646 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dba0f340-870b-4a07-9dc2-65e4b5cd1a73 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.476543 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dba0f340-870b-4a07-9dc2-65e4b5cd1a73 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048251 Jan 19 16:30:56.477134 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 443/998] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:56.565125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-afbe28b6-6cfa-4121-96c8-6ccdc33fcec2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:56.565960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-afbe28b6-6cfa-4121-96c8-6ccdc33fcec2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:56.572451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afbe28b6-6cfa-4121-96c8-6ccdc33fcec2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.572900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afbe28b6-6cfa-4121-96c8-6ccdc33fcec2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.574310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afbe28b6-6cfa-4121-96c8-6ccdc33fcec2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.574756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afbe28b6-6cfa-4121-96c8-6ccdc33fcec2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.605087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-afbe28b6-6cfa-4121-96c8-6ccdc33fcec2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Jan 19 16:30:56.605662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 556/999] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:56.635483 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:56.636734 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:56.643396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.643891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.644703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:56.645138 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:56.709148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:56.718078 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-91328887-1d39-4a89-9aa0-ed755e98bbdd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085850 Jan 19 16:30:56.718806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 444/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:56 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:57.210742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:57.211503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:57.218571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.219054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.219903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.220348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.364102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:57.379241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:57.382049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:57.383382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d5d4d203-84bf-4f08-8963-b9c2512af5dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.176748 Jan 19 16:30:57.383992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 557/1001] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:57 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:30:57.488421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-44af0dfb-ef89-42dd-8d29-cad2d0b3fe8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:57.489217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-44af0dfb-ef89-42dd-8d29-cad2d0b3fe8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:57.495406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44af0dfb-ef89-42dd-8d29-cad2d0b3fe8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.495895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44af0dfb-ef89-42dd-8d29-cad2d0b3fe8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.496680 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44af0dfb-ef89-42dd-8d29-cad2d0b3fe8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.497115 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-44af0dfb-ef89-42dd-8d29-cad2d0b3fe8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.527747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-44af0dfb-ef89-42dd-8d29-cad2d0b3fe8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 Jan 19 16:30:57.528330 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 445/1002] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:57.616535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5d009568-f10b-4500-b68f-b36985a51bfc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:57.617485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5d009568-f10b-4500-b68f-b36985a51bfc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:57.624472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d009568-f10b-4500-b68f-b36985a51bfc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.624922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d009568-f10b-4500-b68f-b36985a51bfc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.625730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d009568-f10b-4500-b68f-b36985a51bfc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.626169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d009568-f10b-4500-b68f-b36985a51bfc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.659730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5d009568-f10b-4500-b68f-b36985a51bfc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046817 Jan 19 16:30:57.660304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 558/1003] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:57.737834 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:57.738508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:57.744972 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.745427 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.746224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:57.746668 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:57.809253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:57.817242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d6a6a1c5-1051-4c69-9f10-4ca7a241de56 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083086 Jan 19 16:30:57.817826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 446/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:57 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:58.404979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:58.405587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:58.412198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.412649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.413449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.413888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.539739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c36f634b-3abf-4c05-ac25-24fcb7c1f244 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:58.540710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c36f634b-3abf-4c05-ac25-24fcb7c1f244 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:58.547758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c36f634b-3abf-4c05-ac25-24fcb7c1f244 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.548112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c36f634b-3abf-4c05-ac25-24fcb7c1f244 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.548917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c36f634b-3abf-4c05-ac25-24fcb7c1f244 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.549364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c36f634b-3abf-4c05-ac25-24fcb7c1f244 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.560905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:58.569899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:58.571399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:58.572615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e32aee8a-e6cf-4cb9-93e2-23051a5367e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.171436 Jan 19 16:30:58.573188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 559/1005] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:58 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:58.581316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c36f634b-3abf-4c05-ac25-24fcb7c1f244 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045348 Jan 19 16:30:58.581994 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 447/1006] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:58.672034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3aa2a5d7-fcf9-4642-880f-96490769a091 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:58.672978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3aa2a5d7-fcf9-4642-880f-96490769a091 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:58.679835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3aa2a5d7-fcf9-4642-880f-96490769a091 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.680302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3aa2a5d7-fcf9-4642-880f-96490769a091 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.681116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3aa2a5d7-fcf9-4642-880f-96490769a091 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.681634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3aa2a5d7-fcf9-4642-880f-96490769a091 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.714459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3aa2a5d7-fcf9-4642-880f-96490769a091 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Jan 19 16:30:58.715185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 560/1007] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:58.835461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:58.836030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:58.843351 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.843855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.844743 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:58.845213 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:58.908703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:58.917387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2114092a-ffac-4e16-b9d8-9a279b333709 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.084982 Jan 19 16:30:58.918031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 448/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:58 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:30:59.595339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:59.595652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f11cc410-f2f3-4f8c-9f0a-910c283022fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:59.596383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:59.596904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f11cc410-f2f3-4f8c-9f0a-910c283022fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:59.604405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.604737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11cc410-f2f3-4f8c-9f0a-910c283022fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.605033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11cc410-f2f3-4f8c-9f0a-910c283022fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:59.605219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:59.605948 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11cc410-f2f3-4f8c-9f0a-910c283022fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.606268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.606485 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11cc410-f2f3-4f8c-9f0a-910c283022fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:59.607120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:59.641691 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f11cc410-f2f3-4f8c-9f0a-910c283022fc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052451 Jan 19 16:30:59.642531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 449/1009] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:30:59.731209 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c762da3c-7e17-4d7f-80d7-fd3f78188122 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:59.732889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c762da3c-7e17-4d7f-80d7-fd3f78188122 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:59.742828 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c762da3c-7e17-4d7f-80d7-fd3f78188122 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.743576 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c762da3c-7e17-4d7f-80d7-fd3f78188122 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:59.745595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c762da3c-7e17-4d7f-80d7-fd3f78188122 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.746379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c762da3c-7e17-4d7f-80d7-fd3f78188122 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:59.762925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:59.772900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:59.774391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:30:59.775564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b1d5cd6-279d-48d1-8c72-6efed98bbdff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.186487 Jan 19 16:30:59.776220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 561/1010] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:30:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:30:59.800343 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c762da3c-7e17-4d7f-80d7-fd3f78188122 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076165 Jan 19 16:30:59.801435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 450/1011] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:30:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:30:59.935204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:30:59.935747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:30:59.942092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.942545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:30:59.943348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:30:59.943818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:00.010973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:00.018880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3975aad-4c41-4ddc-b4a8-4581b881622e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.088126 Jan 19 16:31:00.019496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 562/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:30:59 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:00.655352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a69d284b-8a5c-4c42-bbe1-c9bc34b887ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:00.656440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a69d284b-8a5c-4c42-bbe1-c9bc34b887ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:00.663771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a69d284b-8a5c-4c42-bbe1-c9bc34b887ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:00.664232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a69d284b-8a5c-4c42-bbe1-c9bc34b887ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:00.665057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a69d284b-8a5c-4c42-bbe1-c9bc34b887ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:00.665507 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a69d284b-8a5c-4c42-bbe1-c9bc34b887ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:00.698735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a69d284b-8a5c-4c42-bbe1-c9bc34b887ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047514 Jan 19 16:31:00.699334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 451/1013] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:00.795935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:00.796676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:00.803333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:00.803831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:00.804646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:00.805084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:00.814572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d1612013-76fc-4013-9e61-79ea45c3708b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:00.815860 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d1612013-76fc-4013-9e61-79ea45c3708b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:00.823750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1612013-76fc-4013-9e61-79ea45c3708b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:00.824365 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1612013-76fc-4013-9e61-79ea45c3708b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:00.825286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1612013-76fc-4013-9e61-79ea45c3708b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:00.825984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d1612013-76fc-4013-9e61-79ea45c3708b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:00.866270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d1612013-76fc-4013-9e61-79ea45c3708b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055768 Jan 19 16:31:00.867296 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 452/1014] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:00.957545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:00.971910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:00.975092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:00.977338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-53f78ba9-c7df-49da-a544-b4a03ca84321 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.184953 Jan 19 16:31:00.978321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 563/1015] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:00 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:31:01.036572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:01.037205 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:01.043912 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:01.044425 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:01.045308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:01.045800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:01.109320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:01.117413 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8c18896e-0f05-43a1-bab0-2873990bc4bb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.084928 Jan 19 16:31:01.118012 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 453/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:01 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:01.710301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ea6e013-2cea-4a7b-a58e-a4325bcd2f2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:01.711204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ea6e013-2cea-4a7b-a58e-a4325bcd2f2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:01.717799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ea6e013-2cea-4a7b-a58e-a4325bcd2f2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:01.718243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ea6e013-2cea-4a7b-a58e-a4325bcd2f2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:01.719009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ea6e013-2cea-4a7b-a58e-a4325bcd2f2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:01.719442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ea6e013-2cea-4a7b-a58e-a4325bcd2f2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:01.749502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ea6e013-2cea-4a7b-a58e-a4325bcd2f2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Jan 19 16:31:01.750150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 564/1017] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:01.878702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9c36f83b-1cb6-4588-bab7-5db4e231b464 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:01.879614 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9c36f83b-1cb6-4588-bab7-5db4e231b464 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:01.886133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9c36f83b-1cb6-4588-bab7-5db4e231b464 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:01.886583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9c36f83b-1cb6-4588-bab7-5db4e231b464 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:01.887367 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9c36f83b-1cb6-4588-bab7-5db4e231b464 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:01.887826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9c36f83b-1cb6-4588-bab7-5db4e231b464 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:01.919971 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9c36f83b-1cb6-4588-bab7-5db4e231b464 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045035 Jan 19 16:31:01.920551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 454/1018] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:01 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:01.996933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:01.997532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:02.004016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.004469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.005269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.005694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.147151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:02.148144 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:02.149250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:02.159342 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.159911 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.161356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.162156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.165305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:02.168023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:02.169243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1fe1e5d3-1561-4a27-b4b7-b4b0b9690a8f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.176036 Jan 19 16:31:02.170848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 565/1019] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:02.247082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:02.258801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9a887910-0edf-43bb-9ea7-33a1177bb9b0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.118931 Jan 19 16:31:02.260827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 455/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:02 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:02.761639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-defe2e6e-f5c6-42f8-835f-a241a6ad4450 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:02.763044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-defe2e6e-f5c6-42f8-835f-a241a6ad4450 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:02.769213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-defe2e6e-f5c6-42f8-835f-a241a6ad4450 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.769671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-defe2e6e-f5c6-42f8-835f-a241a6ad4450 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.770464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-defe2e6e-f5c6-42f8-835f-a241a6ad4450 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.770906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-defe2e6e-f5c6-42f8-835f-a241a6ad4450 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.804430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-defe2e6e-f5c6-42f8-835f-a241a6ad4450 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Jan 19 16:31:02.805026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 566/1021] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:02.934146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2a18bdc7-ea20-46f2-8ce5-9633a8e2cd67 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:02.935386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2a18bdc7-ea20-46f2-8ce5-9633a8e2cd67 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:02.941953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a18bdc7-ea20-46f2-8ce5-9633a8e2cd67 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.942405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a18bdc7-ea20-46f2-8ce5-9633a8e2cd67 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.943190 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a18bdc7-ea20-46f2-8ce5-9633a8e2cd67 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:02.943624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2a18bdc7-ea20-46f2-8ce5-9633a8e2cd67 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:02.973709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2a18bdc7-ea20-46f2-8ce5-9633a8e2cd67 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Jan 19 16:31:02.974274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 456/1022] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:03.198530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:03.199174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:03.205741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.206197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:03.207003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.207443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:03.276143 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:03.276763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:03.283248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.283757 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:03.284586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.285035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:03.352397 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:03.360195 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-acf89428-bb34-4180-9c11-cb64af80d743 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087656 Jan 19 16:31:03.365279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 457/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:03 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:03.377085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:03.386777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:03.388264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:03.389662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-96eda214-ccc9-45c0-bd62-0cc3ea0a0e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.195234 Jan 19 16:31:03.389971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 567/1024] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:03 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:03.821413 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6cc6d4a7-67e0-4529-8ce8-61ab56a3fb17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:03.823124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6cc6d4a7-67e0-4529-8ce8-61ab56a3fb17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:03.833841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6cc6d4a7-67e0-4529-8ce8-61ab56a3fb17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.834657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6cc6d4a7-67e0-4529-8ce8-61ab56a3fb17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:03.836074 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6cc6d4a7-67e0-4529-8ce8-61ab56a3fb17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.836658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6cc6d4a7-67e0-4529-8ce8-61ab56a3fb17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:03.868252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6cc6d4a7-67e0-4529-8ce8-61ab56a3fb17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054227 Jan 19 16:31:03.868827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 458/1025] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:03.985887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-51a6439b-8f5f-4a61-a27a-56372b01f70c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:03.986857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-51a6439b-8f5f-4a61-a27a-56372b01f70c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:03.993470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51a6439b-8f5f-4a61-a27a-56372b01f70c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.993921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51a6439b-8f5f-4a61-a27a-56372b01f70c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:03.994747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51a6439b-8f5f-4a61-a27a-56372b01f70c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:03.995181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51a6439b-8f5f-4a61-a27a-56372b01f70c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:04.026697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-51a6439b-8f5f-4a61-a27a-56372b01f70c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Jan 19 16:31:04.027286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 568/1026] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:04.377774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:04.378389 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:04.384988 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:04.385929 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:04.386730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:04.387157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:04.420196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:04.421193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:04.429457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:04.429911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:04.434189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:04.434189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:04.474432 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:04.487471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bdf99bb1-a4be-4f39-99bd-ce4baf4f637f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.112896 Jan 19 16:31:04.488720 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 459/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:04 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:04.582368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:04.591969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:04.593481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:04.594716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c08f9b0c-4643-4887-9dca-39b3969ed34e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.181123 Jan 19 16:31:04.595296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 569/1028] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:04 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:04.881111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2f7ed634-4f30-4aa1-9e7b-5ee870398b47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:04.882024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2f7ed634-4f30-4aa1-9e7b-5ee870398b47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:04.889288 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f7ed634-4f30-4aa1-9e7b-5ee870398b47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:04.889754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f7ed634-4f30-4aa1-9e7b-5ee870398b47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:04.890736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f7ed634-4f30-4aa1-9e7b-5ee870398b47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:04.891213 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2f7ed634-4f30-4aa1-9e7b-5ee870398b47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:04.922864 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2f7ed634-4f30-4aa1-9e7b-5ee870398b47 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Jan 19 16:31:04.923480 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 460/1029] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:05.040191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-446af12c-60a7-4245-b1a2-0931fa8748ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:05.041126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-446af12c-60a7-4245-b1a2-0931fa8748ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:05.047836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-446af12c-60a7-4245-b1a2-0931fa8748ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.048293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-446af12c-60a7-4245-b1a2-0931fa8748ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.049090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-446af12c-60a7-4245-b1a2-0931fa8748ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.049524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-446af12c-60a7-4245-b1a2-0931fa8748ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.080790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-446af12c-60a7-4245-b1a2-0931fa8748ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Jan 19 16:31:05.081384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 570/1030] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:05.514809 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:05.515417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:05.521868 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.522323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.523199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.523643 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.583125 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:05.591705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-52bb198e-f11a-4e48-941b-30cb222580bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080410 Jan 19 16:31:05.592354 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 461/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:05 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:05.617961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:05.618552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:05.625334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.625786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.626585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.627023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.772233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:05.781138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:05.782626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:05.784068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f6e2c043-9005-40d7-a484-f74aa4a06ee1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.170090 Jan 19 16:31:05.784620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 571/1032] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:05 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:05.934271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-202ccd49-ad82-492c-92ba-742fd9f3948f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:05.935179 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-202ccd49-ad82-492c-92ba-742fd9f3948f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:05.941169 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-202ccd49-ad82-492c-92ba-742fd9f3948f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.941681 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-202ccd49-ad82-492c-92ba-742fd9f3948f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.942508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-202ccd49-ad82-492c-92ba-742fd9f3948f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:05.942945 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-202ccd49-ad82-492c-92ba-742fd9f3948f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:05.975233 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-202ccd49-ad82-492c-92ba-742fd9f3948f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Jan 19 16:31:05.975833 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 462/1033] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:06.094042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6d00c383-1809-4dd4-801e-03df02c0d7ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:06.094971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6d00c383-1809-4dd4-801e-03df02c0d7ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:06.101481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d00c383-1809-4dd4-801e-03df02c0d7ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.101943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d00c383-1809-4dd4-801e-03df02c0d7ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:06.102803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d00c383-1809-4dd4-801e-03df02c0d7ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.103198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d00c383-1809-4dd4-801e-03df02c0d7ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:06.132151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6d00c383-1809-4dd4-801e-03df02c0d7ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Jan 19 16:31:06.132711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 572/1034] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:06.608390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:06.609017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:06.615131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.615583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:06.616437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.616904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:06.685211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:06.692703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e5252164-c8b9-4c51-8024-e2289be6d591 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.088428 Jan 19 16:31:06.693272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 463/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:06 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:06.804654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:06.805296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:06.814567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.815033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:06.816173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.816906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:06.956598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:06.965192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:06.967187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:06.968381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1e9e12dc-5251-4683-bfc4-59c43b5b2edc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.169023 Jan 19 16:31:06.968952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 573/1036] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:06 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:06.987019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-57c09c7a-dbd6-4979-8081-fd473c7cef0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:06.987983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-57c09c7a-dbd6-4979-8081-fd473c7cef0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:06.994257 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57c09c7a-dbd6-4979-8081-fd473c7cef0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.994710 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57c09c7a-dbd6-4979-8081-fd473c7cef0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:06.995491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57c09c7a-dbd6-4979-8081-fd473c7cef0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:06.995963 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57c09c7a-dbd6-4979-8081-fd473c7cef0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:07.026727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-57c09c7a-dbd6-4979-8081-fd473c7cef0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Jan 19 16:31:07.027324 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 464/1037] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:07.144643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dca06be9-fb1f-441a-960c-f1b148e2eeae tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:07.145564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dca06be9-fb1f-441a-960c-f1b148e2eeae tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:07.151825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dca06be9-fb1f-441a-960c-f1b148e2eeae tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:07.152690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dca06be9-fb1f-441a-960c-f1b148e2eeae tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:07.155170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dca06be9-fb1f-441a-960c-f1b148e2eeae tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:07.155923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dca06be9-fb1f-441a-960c-f1b148e2eeae tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:07.189505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dca06be9-fb1f-441a-960c-f1b148e2eeae tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048750 Jan 19 16:31:07.190054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 574/1038] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:07.709219 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:07.709836 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:07.716131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:07.717236 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:07.718008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:07.718438 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:07.778631 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:07.786840 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bf4ce85b-fac3-4978-9858-76fcb67e549f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081266 Jan 19 16:31:07.787401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 465/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:07 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:07.987333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:07.987966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:07.994441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:07.994885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:07.995924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:07.996359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:08.038433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-feeecd35-47b5-45fe-93c9-c26b6ebe9f83 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:08.039351 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-feeecd35-47b5-45fe-93c9-c26b6ebe9f83 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:08.045263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-feeecd35-47b5-45fe-93c9-c26b6ebe9f83 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:08.045719 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-feeecd35-47b5-45fe-93c9-c26b6ebe9f83 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:08.046512 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-feeecd35-47b5-45fe-93c9-c26b6ebe9f83 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:08.046955 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-feeecd35-47b5-45fe-93c9-c26b6ebe9f83 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:08.081867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-feeecd35-47b5-45fe-93c9-c26b6ebe9f83 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047119 Jan 19 16:31:08.082437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 466/1040] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:08.128647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:08.137918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:08.140147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:08.141289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0f350cf3-882e-4005-87fa-35d7e85b9911 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158460 Jan 19 16:31:08.141902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 575/1041] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:08.201789 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6c4c1b8c-9717-4921-ab1b-4ebc14251047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:08.202908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6c4c1b8c-9717-4921-ab1b-4ebc14251047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:08.209034 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c4c1b8c-9717-4921-ab1b-4ebc14251047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:08.209488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c4c1b8c-9717-4921-ab1b-4ebc14251047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:08.210274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c4c1b8c-9717-4921-ab1b-4ebc14251047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:08.210711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c4c1b8c-9717-4921-ab1b-4ebc14251047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:08.242419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6c4c1b8c-9717-4921-ab1b-4ebc14251047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Jan 19 16:31:08.242912 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 467/1042] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:08.804084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:08.804721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:08.811012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:08.812074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:08.812873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:08.813304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:08.878690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:08.886098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a441692a-87a5-4607-9cf3-84008f7f66f9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085759 Jan 19 16:31:08.886694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 576/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:08 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:09.094212 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7d8fc1eb-c087-4d39-bf10-d54f27166e03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:09.095124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7d8fc1eb-c087-4d39-bf10-d54f27166e03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:09.101101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7d8fc1eb-c087-4d39-bf10-d54f27166e03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.101555 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7d8fc1eb-c087-4d39-bf10-d54f27166e03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.102364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7d8fc1eb-c087-4d39-bf10-d54f27166e03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.102805 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7d8fc1eb-c087-4d39-bf10-d54f27166e03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.140235 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7d8fc1eb-c087-4d39-bf10-d54f27166e03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050478 Jan 19 16:31:09.140833 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 468/1044] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:09.161393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:09.162004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:09.168546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.169003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.169799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.170234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.253453 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8af1bc75-7e52-4ea7-8503-cc9cde29f50e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:09.254375 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8af1bc75-7e52-4ea7-8503-cc9cde29f50e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:09.260701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8af1bc75-7e52-4ea7-8503-cc9cde29f50e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.261159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8af1bc75-7e52-4ea7-8503-cc9cde29f50e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.262411 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8af1bc75-7e52-4ea7-8503-cc9cde29f50e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.262411 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8af1bc75-7e52-4ea7-8503-cc9cde29f50e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.292881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8af1bc75-7e52-4ea7-8503-cc9cde29f50e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Jan 19 16:31:09.293465 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 469/1045] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:09.303143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:09.312227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:09.313754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:09.314920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8ff360b1-c805-45fd-8a22-1be6f5de12a5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158036 Jan 19 16:31:09.315479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 577/1046] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:09 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:09.902961 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:09.903570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:09.909889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.910328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.911094 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:09.911520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:09.973238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:09.980781 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1f9ef95c-9427-4ddc-ab25-1fed438f35ad tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081499 Jan 19 16:31:09.981349 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 470/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:09 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:10.151358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2851ceba-eeaf-4df3-9b13-aaf48f470360 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:10.152304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2851ceba-eeaf-4df3-9b13-aaf48f470360 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:10.158812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2851ceba-eeaf-4df3-9b13-aaf48f470360 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:10.159361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2851ceba-eeaf-4df3-9b13-aaf48f470360 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:10.160200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2851ceba-eeaf-4df3-9b13-aaf48f470360 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:10.160698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2851ceba-eeaf-4df3-9b13-aaf48f470360 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:10.190397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2851ceba-eeaf-4df3-9b13-aaf48f470360 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042712 Jan 19 16:31:10.191034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 578/1048] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:10.304936 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ca733404-154d-4d45-9eee-5f663fcf9279 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:10.305863 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ca733404-154d-4d45-9eee-5f663fcf9279 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:10.313158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca733404-154d-4d45-9eee-5f663fcf9279 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:10.313612 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca733404-154d-4d45-9eee-5f663fcf9279 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:10.314413 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca733404-154d-4d45-9eee-5f663fcf9279 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:10.314886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca733404-154d-4d45-9eee-5f663fcf9279 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:10.332904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:10.333514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:10.339312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:10.339801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:10.340591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:10.341025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:10.343973 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ca733404-154d-4d45-9eee-5f663fcf9279 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Jan 19 16:31:10.344544 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 471/1049] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:10.472414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:10.480651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:10.482161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:10.483844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-03b2dae4-c987-45ff-b36d-4b5ba358ab9d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154094 Jan 19 16:31:10.484405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 579/1050] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:10 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:31:10.996523 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:10.997124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:11.003042 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.003491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.004290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.004724 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.063153 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:11.070536 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bdc95691-4ba0-4206-8dc6-fbf3d80cc080 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077610 Jan 19 16:31:11.071107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 472/1051] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:10 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:11.201885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76e55f43-07ad-48ab-80dc-a5248b4e3176 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:11.202828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76e55f43-07ad-48ab-80dc-a5248b4e3176 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:11.209397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76e55f43-07ad-48ab-80dc-a5248b4e3176 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.209846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76e55f43-07ad-48ab-80dc-a5248b4e3176 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.210620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76e55f43-07ad-48ab-80dc-a5248b4e3176 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.211055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76e55f43-07ad-48ab-80dc-a5248b4e3176 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.244141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76e55f43-07ad-48ab-80dc-a5248b4e3176 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045984 Jan 19 16:31:11.244696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 580/1052] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:11.355398 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c251829b-d316-487f-aaec-d404fd1b0415 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:11.356270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c251829b-d316-487f-aaec-d404fd1b0415 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:11.363110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c251829b-d316-487f-aaec-d404fd1b0415 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.363562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c251829b-d316-487f-aaec-d404fd1b0415 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.364371 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c251829b-d316-487f-aaec-d404fd1b0415 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.364811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c251829b-d316-487f-aaec-d404fd1b0415 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.397305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c251829b-d316-487f-aaec-d404fd1b0415 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Jan 19 16:31:11.397870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 473/1053] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:11.502082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:11.502681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:11.508856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.509302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.510088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:11.510519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:11.645479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:11.660202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:11.661695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:11.662894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b242e3a7-25fd-4888-924c-ed1455e6a731 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.164619 Jan 19 16:31:11.663454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 581/1054] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:11 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:12.087623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:12.088241 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:12.094472 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.094927 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.095713 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.096150 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.156305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:12.163953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f87c9cce-c2c2-4239-96d7-df34a31dfafb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079915 Jan 19 16:31:12.164521 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 474/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:12 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:12.256157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b1741b94-f7b3-4d92-929d-ba96b51751cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:12.257116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b1741b94-f7b3-4d92-929d-ba96b51751cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:12.263341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1741b94-f7b3-4d92-929d-ba96b51751cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.263826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1741b94-f7b3-4d92-929d-ba96b51751cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.265266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1741b94-f7b3-4d92-929d-ba96b51751cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.265704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b1741b94-f7b3-4d92-929d-ba96b51751cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.295738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b1741b94-f7b3-4d92-929d-ba96b51751cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Jan 19 16:31:12.296300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 582/1056] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:12.409089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b29639d5-694f-4fb6-8e0c-4c1197c401d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:12.409920 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b29639d5-694f-4fb6-8e0c-4c1197c401d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:12.416375 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29639d5-694f-4fb6-8e0c-4c1197c401d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.416839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29639d5-694f-4fb6-8e0c-4c1197c401d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.417739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29639d5-694f-4fb6-8e0c-4c1197c401d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.418189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b29639d5-694f-4fb6-8e0c-4c1197c401d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.448417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b29639d5-694f-4fb6-8e0c-4c1197c401d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Jan 19 16:31:12.448978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 475/1057] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:12.681993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:12.682698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:12.689514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.689965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.690784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:12.691230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:12.822386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:12.830646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:12.832151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:12.833281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3442a329-b352-45c7-883d-48db06015f5f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155261 Jan 19 16:31:12.833831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 583/1058] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:13.180060 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:13.180664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:13.187047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.187492 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.188286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.188719 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.248371 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:13.256336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ce7b5f92-2125-4cdf-aea7-25afdd5d638e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079868 Jan 19 16:31:13.256909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 476/1059] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:13 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:13.307210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ea1ea035-4509-4754-8574-77666f076fa5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:13.308140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ea1ea035-4509-4754-8574-77666f076fa5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:13.314925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea1ea035-4509-4754-8574-77666f076fa5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.315371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea1ea035-4509-4754-8574-77666f076fa5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.316171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea1ea035-4509-4754-8574-77666f076fa5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.316602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea1ea035-4509-4754-8574-77666f076fa5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.345119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ea1ea035-4509-4754-8574-77666f076fa5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 Jan 19 16:31:13.345660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 584/1060] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:13.460856 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a04d16ee-67af-40b1-ba0f-9773fcf076e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:13.461769 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a04d16ee-67af-40b1-ba0f-9773fcf076e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:13.468072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a04d16ee-67af-40b1-ba0f-9773fcf076e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.468528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a04d16ee-67af-40b1-ba0f-9773fcf076e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.469305 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a04d16ee-67af-40b1-ba0f-9773fcf076e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.469744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a04d16ee-67af-40b1-ba0f-9773fcf076e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.499472 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a04d16ee-67af-40b1-ba0f-9773fcf076e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041812 Jan 19 16:31:13.500092 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 477/1061] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:13.852040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:13.852594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:13.859042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.859523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.860323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:13.860757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:13.988345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:13.996711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:13.998209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:13.999463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d15c9821-300c-4e37-8e4a-4ffae42fcf3a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151181 Jan 19 16:31:14.000062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 585/1062] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:14.272983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:14.273586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:14.279440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:14.279923 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:14.281274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:14.281706 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:14.339493 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:14.346935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c8d2ab31-7e8d-429d-b42d-585f1e854905 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077519 Jan 19 16:31:14.347501 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 478/1063] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:14 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:14.356216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aa5dd0d3-ddff-4321-a2f2-3e6391ecc3cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:14.357124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aa5dd0d3-ddff-4321-a2f2-3e6391ecc3cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:14.363347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa5dd0d3-ddff-4321-a2f2-3e6391ecc3cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:14.363840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa5dd0d3-ddff-4321-a2f2-3e6391ecc3cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:14.364624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa5dd0d3-ddff-4321-a2f2-3e6391ecc3cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:14.365066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa5dd0d3-ddff-4321-a2f2-3e6391ecc3cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:14.394101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aa5dd0d3-ddff-4321-a2f2-3e6391ecc3cb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Jan 19 16:31:14.394651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 586/1064] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:14.510460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7074d4e0-0940-4a37-b3e5-efac86d9bb10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:14.511374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7074d4e0-0940-4a37-b3e5-efac86d9bb10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:14.521019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7074d4e0-0940-4a37-b3e5-efac86d9bb10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:14.521468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7074d4e0-0940-4a37-b3e5-efac86d9bb10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:14.522245 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7074d4e0-0940-4a37-b3e5-efac86d9bb10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:14.522688 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7074d4e0-0940-4a37-b3e5-efac86d9bb10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:14.552489 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7074d4e0-0940-4a37-b3e5-efac86d9bb10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Jan 19 16:31:14.553158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 479/1065] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:15.017663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:15.018274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:15.031299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.031774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.032558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.033258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.160431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:15.168597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:15.170099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:15.171910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ad8a26f-9918-4f09-aa7f-bd371077b702 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157978 Jan 19 16:31:15.172483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 587/1066] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:15 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:15.405959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be57ec14-7f9a-4eca-a761-429505c12009 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:15.407059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be57ec14-7f9a-4eca-a761-429505c12009 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:15.411313 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:15.411953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:15.413715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be57ec14-7f9a-4eca-a761-429505c12009 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.414175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be57ec14-7f9a-4eca-a761-429505c12009 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.414957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be57ec14-7f9a-4eca-a761-429505c12009 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.415402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be57ec14-7f9a-4eca-a761-429505c12009 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.417726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.418176 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.418956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.419396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.445839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be57ec14-7f9a-4eca-a761-429505c12009 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044043 Jan 19 16:31:15.446645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 588/1067] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:15.482018 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:15.489239 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6955ddaf-a6ed-4ee4-a930-4829a62765d6 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.128685 Jan 19 16:31:15.489806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 480/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:15 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:15.563779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a84ea4d3-473c-42f7-9876-e9766d74fa48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:15.564690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a84ea4d3-473c-42f7-9876-e9766d74fa48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:15.570631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a84ea4d3-473c-42f7-9876-e9766d74fa48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.571088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a84ea4d3-473c-42f7-9876-e9766d74fa48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.571896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a84ea4d3-473c-42f7-9876-e9766d74fa48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:15.572339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a84ea4d3-473c-42f7-9876-e9766d74fa48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:15.602645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a84ea4d3-473c-42f7-9876-e9766d74fa48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Jan 19 16:31:15.603200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 589/1069] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:16.190432 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:16.191130 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:16.197761 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.198245 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.199057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.199492 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.332361 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:16.340705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:16.342200 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:16.343353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8478c6b4-72e9-4b28-b21c-0b13431e3a9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157171 Jan 19 16:31:16.343999 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 481/1070] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:16.457262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2cce74f4-4c5d-4c6f-b5ed-8b3b71a68bd4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:16.458179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2cce74f4-4c5d-4c6f-b5ed-8b3b71a68bd4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:16.464500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cce74f4-4c5d-4c6f-b5ed-8b3b71a68bd4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.464957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cce74f4-4c5d-4c6f-b5ed-8b3b71a68bd4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.465739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cce74f4-4c5d-4c6f-b5ed-8b3b71a68bd4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.466178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cce74f4-4c5d-4c6f-b5ed-8b3b71a68bd4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.495657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2cce74f4-4c5d-4c6f-b5ed-8b3b71a68bd4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042111 Jan 19 16:31:16.496241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 590/1071] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:16.505783 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:16.506390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:16.512464 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.512913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.513727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.514162 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.577588 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:16.585007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cfcea1d1-c25b-496c-846f-cbe2be8c1c47 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082846 Jan 19 16:31:16.585576 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 482/1072] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:16 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:16.614655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fff8f1b9-e38f-404e-b86b-3f1b878ce41f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:16.615557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fff8f1b9-e38f-404e-b86b-3f1b878ce41f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:16.621615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff8f1b9-e38f-404e-b86b-3f1b878ce41f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.622050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff8f1b9-e38f-404e-b86b-3f1b878ce41f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.622828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff8f1b9-e38f-404e-b86b-3f1b878ce41f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:16.623260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff8f1b9-e38f-404e-b86b-3f1b878ce41f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:16.653509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fff8f1b9-e38f-404e-b86b-3f1b878ce41f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Jan 19 16:31:16.654073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 591/1073] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:17.361913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:17.362623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:17.369736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.370341 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.371157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.371601 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.509039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9b339819-5f0c-41a8-8a05-6cd5ae24e627 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:17.510654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9b339819-5f0c-41a8-8a05-6cd5ae24e627 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:17.521700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b339819-5f0c-41a8-8a05-6cd5ae24e627 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.522227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b339819-5f0c-41a8-8a05-6cd5ae24e627 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.525058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b339819-5f0c-41a8-8a05-6cd5ae24e627 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.526581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b339819-5f0c-41a8-8a05-6cd5ae24e627 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.530129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:17.538754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:17.540376 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:17.541540 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e5bcf729-566e-41b8-ba5b-5c881eb829ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.183488 Jan 19 16:31:17.542101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 483/1074] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:17 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:17.561077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9b339819-5f0c-41a8-8a05-6cd5ae24e627 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057095 Jan 19 16:31:17.562160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 592/1075] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:17.602168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:17.602775 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:17.608766 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.609220 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.610021 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.610491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.665565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f5bc23e2-9f85-4795-b3b4-34b20043e56a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:17.666392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f5bc23e2-9f85-4795-b3b4-34b20043e56a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:17.672063 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:17.676133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5bc23e2-9f85-4795-b3b4-34b20043e56a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.677183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5bc23e2-9f85-4795-b3b4-34b20043e56a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.677411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5bc23e2-9f85-4795-b3b4-34b20043e56a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:17.677897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5bc23e2-9f85-4795-b3b4-34b20043e56a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:17.679813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-61b23357-2d7c-48e5-8cfd-e1ff649c815a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081253 Jan 19 16:31:17.680400 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 484/1076] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:17 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:17.710386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f5bc23e2-9f85-4795-b3b4-34b20043e56a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048701 Jan 19 16:31:17.710949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 593/1077] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:18.559393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:18.560025 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:18.567064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.567529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.568449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.568892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.573155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dcc2b1e9-44c6-4166-b2a3-a0e3ffa4c8f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:18.574082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dcc2b1e9-44c6-4166-b2a3-a0e3ffa4c8f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:18.581352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcc2b1e9-44c6-4166-b2a3-a0e3ffa4c8f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.581804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcc2b1e9-44c6-4166-b2a3-a0e3ffa4c8f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.582609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcc2b1e9-44c6-4166-b2a3-a0e3ffa4c8f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.583051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcc2b1e9-44c6-4166-b2a3-a0e3ffa4c8f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.614355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dcc2b1e9-44c6-4166-b2a3-a0e3ffa4c8f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044993 Jan 19 16:31:18.614941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 594/1078] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:18.697195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:18.697804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:18.704498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.705334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.706136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.706581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.729913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:18.739195 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:18.741568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:18.742752 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9d729195-3170-458b-8c3b-042dc212310c tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.187223 Jan 19 16:31:18.743307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 485/1079] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:18 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:18.748508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ca252d4e-5327-4f27-93fc-a9ef1047954c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:18.750369 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ca252d4e-5327-4f27-93fc-a9ef1047954c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:18.756406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca252d4e-5327-4f27-93fc-a9ef1047954c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.756857 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca252d4e-5327-4f27-93fc-a9ef1047954c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.757653 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca252d4e-5327-4f27-93fc-a9ef1047954c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:18.758087 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ca252d4e-5327-4f27-93fc-a9ef1047954c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:18.768742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:18.776634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d794b661-9b7a-4f24-9fb1-a09e20019a3f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083075 Jan 19 16:31:18.777555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 595/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:18 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:18.791209 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ca252d4e-5327-4f27-93fc-a9ef1047954c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Jan 19 16:31:18.791809 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 486/1081] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:19.626555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e851e3be-a667-43bf-9ebf-8887db849a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:19.627481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e851e3be-a667-43bf-9ebf-8887db849a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:19.634074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e851e3be-a667-43bf-9ebf-8887db849a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.634535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e851e3be-a667-43bf-9ebf-8887db849a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.635337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e851e3be-a667-43bf-9ebf-8887db849a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.635808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e851e3be-a667-43bf-9ebf-8887db849a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.668047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e851e3be-a667-43bf-9ebf-8887db849a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 Jan 19 16:31:19.668631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 596/1082] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:19.765252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:19.765853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:19.772990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.773570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.774379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.774983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.793481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:19.794121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:19.800645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.801089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.801868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.802306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.871053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:19.879309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a78206b2-ce40-44b4-bd46-831944653465 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.089367 Jan 19 16:31:19.879911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 597/1083] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:19 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:19.884593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-62076fa0-194e-4971-a5a0-bd389c9443c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:19.885405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-62076fa0-194e-4971-a5a0-bd389c9443c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:19.894689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62076fa0-194e-4971-a5a0-bd389c9443c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.895309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62076fa0-194e-4971-a5a0-bd389c9443c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.896175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62076fa0-194e-4971-a5a0-bd389c9443c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:19.896613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62076fa0-194e-4971-a5a0-bd389c9443c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:19.927407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-62076fa0-194e-4971-a5a0-bd389c9443c5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046437 Jan 19 16:31:19.928246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 598/1084] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:19.938623 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:19.947049 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:19.948626 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:19.949814 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8c123cc9-0126-4154-884a-d84d80f67de1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.189655 Jan 19 16:31:19.950368 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 487/1085] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:20.679370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-601cc873-ad5a-4a87-991a-d8549f13a83e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:20.680278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-601cc873-ad5a-4a87-991a-d8549f13a83e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:20.686503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601cc873-ad5a-4a87-991a-d8549f13a83e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.686955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601cc873-ad5a-4a87-991a-d8549f13a83e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:20.687775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601cc873-ad5a-4a87-991a-d8549f13a83e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.688217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601cc873-ad5a-4a87-991a-d8549f13a83e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:20.716567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-601cc873-ad5a-4a87-991a-d8549f13a83e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041236 Jan 19 16:31:20.717120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 599/1086] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:20.896101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:20.896742 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:20.903097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.903549 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:20.904355 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.904798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:20.938763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c26a8a4a-8dbe-4551-bd5b-651f73fd3988 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:20.939579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c26a8a4a-8dbe-4551-bd5b-651f73fd3988 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:20.945527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c26a8a4a-8dbe-4551-bd5b-651f73fd3988 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.945972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c26a8a4a-8dbe-4551-bd5b-651f73fd3988 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:20.946747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c26a8a4a-8dbe-4551-bd5b-651f73fd3988 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.947177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c26a8a4a-8dbe-4551-bd5b-651f73fd3988 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:20.963744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:20.971667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-19c5f7b5-ad47-48cc-9f5a-d57b11b76eec tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079130 Jan 19 16:31:20.972276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 488/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:20 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:20.976732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:20.977337 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:20.977784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c26a8a4a-8dbe-4551-bd5b-651f73fd3988 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 Jan 19 16:31:20.981621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 600/1088] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:20.983064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.983515 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:20.984327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:20.984765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:21.113212 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:21.121302 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:21.122807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:21.124476 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fe45f6ed-14be-49dc-a775-5551beee179a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150620 Jan 19 16:31:21.125031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 489/1089] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:20 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:21.357456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:31:21.357741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:31:21.728142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b6ac29c7-88ba-45c4-bbc2-9419889b4214 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:21.729055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b6ac29c7-88ba-45c4-bbc2-9419889b4214 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:21.735839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6ac29c7-88ba-45c4-bbc2-9419889b4214 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:21.736296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6ac29c7-88ba-45c4-bbc2-9419889b4214 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:21.737067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6ac29c7-88ba-45c4-bbc2-9419889b4214 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:21.737504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6ac29c7-88ba-45c4-bbc2-9419889b4214 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:21.766459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b6ac29c7-88ba-45c4-bbc2-9419889b4214 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041958 Jan 19 16:31:21.768103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 601/1090] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:21.988625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:21.988834 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f652aca2-b3e8-41ad-bd6b-e8cf34c511fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:21.989304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:21.989797 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f652aca2-b3e8-41ad-bd6b-e8cf34c511fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:21.995216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:21.995669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:21.995960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f652aca2-b3e8-41ad-bd6b-e8cf34c511fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:21.996409 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f652aca2-b3e8-41ad-bd6b-e8cf34c511fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:21.996504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:21.996893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:21.997181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f652aca2-b3e8-41ad-bd6b-e8cf34c511fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:21.997617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f652aca2-b3e8-41ad-bd6b-e8cf34c511fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:22.026671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f652aca2-b3e8-41ad-bd6b-e8cf34c511fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041578 Jan 19 16:31:22.027236 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 490/1091] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:22.055271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:22.062616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-49623fcd-98b2-437e-86d3-0647a2afc23e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077595 Jan 19 16:31:22.063163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 602/1092] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:21 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:22.142387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:22.142994 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:22.148968 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:22.149420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:22.150197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:22.150636 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:22.278735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:22.288071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:22.289567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:22.290717 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-47bce6fd-ea80-49be-b6ba-45bf2b72a6e3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152074 Jan 19 16:31:22.291284 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 491/1093] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:22 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:22.777948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-517b1275-8cf1-4a02-a7ff-1984cc2d8a5c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:22.778870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-517b1275-8cf1-4a02-a7ff-1984cc2d8a5c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:22.785811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-517b1275-8cf1-4a02-a7ff-1984cc2d8a5c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:22.786257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-517b1275-8cf1-4a02-a7ff-1984cc2d8a5c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:22.787048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-517b1275-8cf1-4a02-a7ff-1984cc2d8a5c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:22.787489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-517b1275-8cf1-4a02-a7ff-1984cc2d8a5c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:22.820011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-517b1275-8cf1-4a02-a7ff-1984cc2d8a5c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045752 Jan 19 16:31:22.820578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 603/1094] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:23.038875 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cfedb46d-08f1-46e8-87dc-cfbca3ec584c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:23.039846 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cfedb46d-08f1-46e8-87dc-cfbca3ec584c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:23.046575 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfedb46d-08f1-46e8-87dc-cfbca3ec584c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.047021 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfedb46d-08f1-46e8-87dc-cfbca3ec584c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.047890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfedb46d-08f1-46e8-87dc-cfbca3ec584c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.048323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfedb46d-08f1-46e8-87dc-cfbca3ec584c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.077092 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cfedb46d-08f1-46e8-87dc-cfbca3ec584c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041856 Jan 19 16:31:23.079715 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 492/1095] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:23.079853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:23.079853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:23.084919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.085369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.086147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.086580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.144578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:23.151918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d274d328-1891-47af-9a20-8f06c0a6c321 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077273 Jan 19 16:31:23.152495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 604/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:23 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:23.309046 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:23.309686 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:23.316217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.316670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.317463 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.317893 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.450357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:23.458477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:23.459997 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:23.461145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-de96a0a6-cca9-47f3-ad30-a32cdf92c92b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156049 Jan 19 16:31:23.461723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 493/1097] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:23 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:23.832363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ac544b98-cb68-4931-b803-7159f5470a9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:23.833277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ac544b98-cb68-4931-b803-7159f5470a9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:23.839575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac544b98-cb68-4931-b803-7159f5470a9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.840065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac544b98-cb68-4931-b803-7159f5470a9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.840841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac544b98-cb68-4931-b803-7159f5470a9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:23.841282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac544b98-cb68-4931-b803-7159f5470a9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:23.870023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ac544b98-cb68-4931-b803-7159f5470a9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041351 Jan 19 16:31:23.870604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 605/1098] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:24.088313 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-655edab7-9834-428f-afc5-6f3bf3591661 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:24.089228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-655edab7-9834-428f-afc5-6f3bf3591661 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:24.095489 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-655edab7-9834-428f-afc5-6f3bf3591661 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.095969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-655edab7-9834-428f-afc5-6f3bf3591661 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.096747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-655edab7-9834-428f-afc5-6f3bf3591661 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.097179 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-655edab7-9834-428f-afc5-6f3bf3591661 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.125555 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-655edab7-9834-428f-afc5-6f3bf3591661 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 Jan 19 16:31:24.126107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 494/1099] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:24.168636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:24.169247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:24.175178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.175627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.176468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.176905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.234680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:24.242208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d4a89215-14f2-468d-85a5-3a12a6d1329e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077281 Jan 19 16:31:24.242778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 606/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:24 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:24.479814 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:24.480427 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:24.487032 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.487486 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.488323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.488766 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.618747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:24.628913 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:24.630401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:24.631739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6ef72d34-a39d-415d-80ee-31ca63a700ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155679 Jan 19 16:31:24.632297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 495/1101] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:24 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:24.880707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6cf7a940-9fbb-4d27-af2c-d47053c1bed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:24.881539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6cf7a940-9fbb-4d27-af2c-d47053c1bed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:24.887871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cf7a940-9fbb-4d27-af2c-d47053c1bed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.888336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cf7a940-9fbb-4d27-af2c-d47053c1bed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.889121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cf7a940-9fbb-4d27-af2c-d47053c1bed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:24.889564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cf7a940-9fbb-4d27-af2c-d47053c1bed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:24.918965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6cf7a940-9fbb-4d27-af2c-d47053c1bed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042090 Jan 19 16:31:24.919509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 607/1102] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:25.136855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7317ae51-64ba-4551-bf04-81ca3c19be8a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:25.137682 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7317ae51-64ba-4551-bf04-81ca3c19be8a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:25.144157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7317ae51-64ba-4551-bf04-81ca3c19be8a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.144619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7317ae51-64ba-4551-bf04-81ca3c19be8a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.145422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7317ae51-64ba-4551-bf04-81ca3c19be8a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.145861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7317ae51-64ba-4551-bf04-81ca3c19be8a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.182621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7317ae51-64ba-4551-bf04-81ca3c19be8a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049426 Jan 19 16:31:25.183126 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 496/1103] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:25.259069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:25.259698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:25.266121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.266596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.267376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.267852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.328715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:25.336006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-750b37e5-cff7-4519-9299-6e9158522a04 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080548 Jan 19 16:31:25.336561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 608/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:25 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:25.648959 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:25.649880 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:25.655900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.656353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.657136 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.657572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.787543 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:25.795825 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:25.797313 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:25.798451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ea06eadf-e183-44a6-9a09-58e30a93dc60 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153181 Jan 19 16:31:25.799014 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 497/1105] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:25 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:25.931198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0b96b750-ac7b-457d-b6c7-cbdf1557f3f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:25.932191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b96b750-ac7b-457d-b6c7-cbdf1557f3f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:25.939325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b96b750-ac7b-457d-b6c7-cbdf1557f3f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.939552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b96b750-ac7b-457d-b6c7-cbdf1557f3f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.940359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b96b750-ac7b-457d-b6c7-cbdf1557f3f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:25.940798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b96b750-ac7b-457d-b6c7-cbdf1557f3f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:25.970814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0b96b750-ac7b-457d-b6c7-cbdf1557f3f6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Jan 19 16:31:25.971384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 609/1106] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:26.194644 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cefe8291-cf41-4f8e-877f-2b73d96698c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:26.195475 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cefe8291-cf41-4f8e-877f-2b73d96698c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:26.202031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cefe8291-cf41-4f8e-877f-2b73d96698c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.202485 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cefe8291-cf41-4f8e-877f-2b73d96698c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:26.203278 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cefe8291-cf41-4f8e-877f-2b73d96698c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.203741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cefe8291-cf41-4f8e-877f-2b73d96698c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:26.235591 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cefe8291-cf41-4f8e-877f-2b73d96698c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Jan 19 16:31:26.236199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 498/1107] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:26.353054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:26.353665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:26.360334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.360792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:26.361579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.362020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:26.422095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:26.430075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c9d8975f-be07-4fd2-bc2d-dd6d81ce6ddf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080639 Jan 19 16:31:26.430636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 610/1108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:26 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:26.816704 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:26.817303 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:26.823345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.823824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:26.824604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.825038 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:26.963738 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:26.972850 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:26.974324 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:26.975468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f7d6ea33-1cd8-4e92-8e49-2aeced3df0a1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162463 Jan 19 16:31:26.976058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 499/1109] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:26 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:26.982226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a8868590-0016-4167-9219-7015e45746d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:26.983212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a8868590-0016-4167-9219-7015e45746d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:26.990885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8868590-0016-4167-9219-7015e45746d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.991335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8868590-0016-4167-9219-7015e45746d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:26.992173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8868590-0016-4167-9219-7015e45746d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:26.992606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8868590-0016-4167-9219-7015e45746d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:27.023601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a8868590-0016-4167-9219-7015e45746d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Jan 19 16:31:27.024201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 611/1110] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:27.246666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-63706708-45d0-4609-89c5-bfdb46359714 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:27.247597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-63706708-45d0-4609-89c5-bfdb46359714 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:27.259463 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63706708-45d0-4609-89c5-bfdb46359714 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:27.259953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63706708-45d0-4609-89c5-bfdb46359714 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:27.260762 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63706708-45d0-4609-89c5-bfdb46359714 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:27.261213 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63706708-45d0-4609-89c5-bfdb46359714 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:27.294518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-63706708-45d0-4609-89c5-bfdb46359714 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051695 Jan 19 16:31:27.295114 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 500/1111] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:27.446820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:27.447428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:27.454176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:27.454671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:27.455665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:27.456141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:27.518504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:27.526484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-37281878-51ed-4105-87de-857df6fa9fbb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083234 Jan 19 16:31:27.527144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 612/1112] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:27 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:27.993594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:27.994170 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:28.000776 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.001234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.002035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.002474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.036591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-47c8450e-5830-4b64-aba9-af403f66ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:28.037678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-47c8450e-5830-4b64-aba9-af403f66ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:28.044490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47c8450e-5830-4b64-aba9-af403f66ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.045047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47c8450e-5830-4b64-aba9-af403f66ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.046701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47c8450e-5830-4b64-aba9-af403f66ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.047007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47c8450e-5830-4b64-aba9-af403f66ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.076907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-47c8450e-5830-4b64-aba9-af403f66ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Jan 19 16:31:28.077675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 613/1113] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:28.136529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:28.145456 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:28.146952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:28.148148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-aac81c61-83bd-43cf-8567-28177f36188e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158279 Jan 19 16:31:28.148714 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 501/1114] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:27 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:28.306196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-899ffbbb-a734-4aef-8606-cdb6b9857f40 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:28.307026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-899ffbbb-a734-4aef-8606-cdb6b9857f40 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:28.313988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-899ffbbb-a734-4aef-8606-cdb6b9857f40 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.314445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-899ffbbb-a734-4aef-8606-cdb6b9857f40 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.315242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-899ffbbb-a734-4aef-8606-cdb6b9857f40 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.315655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-899ffbbb-a734-4aef-8606-cdb6b9857f40 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.352181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-899ffbbb-a734-4aef-8606-cdb6b9857f40 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049732 Jan 19 16:31:28.352761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 614/1115] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:28.544031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:28.544648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:28.551224 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.551812 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.552506 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:28.552947 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:28.615514 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:28.623782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b386505a-c2be-43d3-a8fb-b2d43e57f5ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082753 Jan 19 16:31:28.624323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 502/1116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:28 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:29.088323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-63c35dd7-43cc-436b-abd4-df0c4a67b20b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:29.089244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-63c35dd7-43cc-436b-abd4-df0c4a67b20b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:29.096224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63c35dd7-43cc-436b-abd4-df0c4a67b20b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.096673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63c35dd7-43cc-436b-abd4-df0c4a67b20b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.097476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63c35dd7-43cc-436b-abd4-df0c4a67b20b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.097908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63c35dd7-43cc-436b-abd4-df0c4a67b20b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.129770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-63c35dd7-43cc-436b-abd4-df0c4a67b20b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 Jan 19 16:31:29.130342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 615/1117] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:29.167532 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:29.168167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:29.175572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.176051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.176846 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.177281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.315949 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:29.324664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:29.326156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:29.327333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c5a13299-8c6c-4247-992b-559294f1c29e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163768 Jan 19 16:31:29.327928 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 503/1118] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:29 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:29.364604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-306ed152-a66b-40df-bd3d-c0a4f72927b8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:29.365443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-306ed152-a66b-40df-bd3d-c0a4f72927b8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:29.371856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-306ed152-a66b-40df-bd3d-c0a4f72927b8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.372319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-306ed152-a66b-40df-bd3d-c0a4f72927b8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.373161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-306ed152-a66b-40df-bd3d-c0a4f72927b8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.373740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-306ed152-a66b-40df-bd3d-c0a4f72927b8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.409201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-306ed152-a66b-40df-bd3d-c0a4f72927b8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Jan 19 16:31:29.409779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 616/1119] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:29.640609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:29.641155 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:29.648015 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.648479 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.649275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:29.649720 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:29.732113 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:29.739654 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8421280f-6f49-4412-9413-53f19796a04c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.102898 Jan 19 16:31:29.740415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 504/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:29 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:30.141672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0cb318f6-60be-44e9-8115-b0af45c33647 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:30.142639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0cb318f6-60be-44e9-8115-b0af45c33647 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:30.149877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0cb318f6-60be-44e9-8115-b0af45c33647 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.150332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0cb318f6-60be-44e9-8115-b0af45c33647 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.151125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0cb318f6-60be-44e9-8115-b0af45c33647 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.151565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0cb318f6-60be-44e9-8115-b0af45c33647 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.183915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0cb318f6-60be-44e9-8115-b0af45c33647 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 Jan 19 16:31:30.184403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 617/1121] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:30.345527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:30.346135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:30.352184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.352640 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.353416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.353856 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.421199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6d292d6-baf0-411b-9f27-73c9a6a2169c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:30.422157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6d292d6-baf0-411b-9f27-73c9a6a2169c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:30.428466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d292d6-baf0-411b-9f27-73c9a6a2169c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.428891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d292d6-baf0-411b-9f27-73c9a6a2169c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.429695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d292d6-baf0-411b-9f27-73c9a6a2169c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.430134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6d292d6-baf0-411b-9f27-73c9a6a2169c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.463103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6d292d6-baf0-411b-9f27-73c9a6a2169c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Jan 19 16:31:30.464091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 618/1122] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:30.487612 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:30.496202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:30.497694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:30.499402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5f89effd-3312-4313-9b9f-db91e796a185 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157609 Jan 19 16:31:30.500024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 505/1123] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:30 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:30.755433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:30.756068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:30.762225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.762777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.763943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:30.765195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:30.824513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:30.832315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-137cd39a-06fc-4fff-8cd0-7c3cb26950de tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080595 Jan 19 16:31:30.833076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 619/1124] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:30 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:31.195725 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6d51b6e1-c8f5-4756-8d3a-f7648dbbb9ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:31.196554 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6d51b6e1-c8f5-4756-8d3a-f7648dbbb9ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:31.203356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d51b6e1-c8f5-4756-8d3a-f7648dbbb9ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.203832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d51b6e1-c8f5-4756-8d3a-f7648dbbb9ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.204612 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d51b6e1-c8f5-4756-8d3a-f7648dbbb9ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.205050 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d51b6e1-c8f5-4756-8d3a-f7648dbbb9ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.236287 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6d51b6e1-c8f5-4756-8d3a-f7648dbbb9ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Jan 19 16:31:31.236851 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 506/1125] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:31.479171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3866334f-b63b-4e00-b810-1a2188cb9180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:31.480175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3866334f-b63b-4e00-b810-1a2188cb9180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:31.486491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3866334f-b63b-4e00-b810-1a2188cb9180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.486945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3866334f-b63b-4e00-b810-1a2188cb9180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.487758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3866334f-b63b-4e00-b810-1a2188cb9180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.488201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3866334f-b63b-4e00-b810-1a2188cb9180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.517314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3866334f-b63b-4e00-b810-1a2188cb9180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Jan 19 16:31:31.517869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 620/1126] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:31.518970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:31.519582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:31.525504 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.525956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.526739 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.527180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.660703 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:31.668792 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:31.670263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:31.671438 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e44bd473-d2aa-4ab3-8b0a-b323d1a777ac tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156287 Jan 19 16:31:31.672041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 507/1127] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:31 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:31:31.849264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:31.849789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:31.855864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.856317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.857109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:31.857578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:31.916774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:31.924197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7af36afa-dc78-4d1e-81eb-378ce4325fa7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078779 Jan 19 16:31:31.924781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 621/1128] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:31 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:32.249055 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4b4ced29-54f5-4451-9d17-ca8bf672ca1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:32.250052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4b4ced29-54f5-4451-9d17-ca8bf672ca1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:32.256761 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4b4ced29-54f5-4451-9d17-ca8bf672ca1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.257219 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4b4ced29-54f5-4451-9d17-ca8bf672ca1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:32.258033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4b4ced29-54f5-4451-9d17-ca8bf672ca1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.258478 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4b4ced29-54f5-4451-9d17-ca8bf672ca1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:32.287266 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4b4ced29-54f5-4451-9d17-ca8bf672ca1b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Jan 19 16:31:32.287854 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 508/1129] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:32.528655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d945e325-d327-4417-9de4-ee56e89ec502 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:32.530006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d945e325-d327-4417-9de4-ee56e89ec502 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:32.536617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d945e325-d327-4417-9de4-ee56e89ec502 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.537076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d945e325-d327-4417-9de4-ee56e89ec502 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:32.537857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d945e325-d327-4417-9de4-ee56e89ec502 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.538305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d945e325-d327-4417-9de4-ee56e89ec502 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:32.566777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d945e325-d327-4417-9de4-ee56e89ec502 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 Jan 19 16:31:32.567331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 622/1130] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:32.688518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:32.689129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:32.695045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.695497 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:32.696303 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.696745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:32.824861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:32.834617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:32.836135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:32.837435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-51f2ca29-07c4-4cd6-bce8-642223fdc982 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152419 Jan 19 16:31:32.838221 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 509/1131] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:32 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:32.941153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:32.942282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:32.947725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.948199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:32.948981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:32.949399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:33.016935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:33.024782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b62ef65c-f482-43e7-abcc-6b9c6902f78f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087796 Jan 19 16:31:33.025359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 623/1132] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:32 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:33.298678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cfdcd9b2-67ed-49ad-8fa4-dd0dfca7f5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:33.299581 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cfdcd9b2-67ed-49ad-8fa4-dd0dfca7f5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:33.305952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfdcd9b2-67ed-49ad-8fa4-dd0dfca7f5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:33.306401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfdcd9b2-67ed-49ad-8fa4-dd0dfca7f5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:33.307177 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfdcd9b2-67ed-49ad-8fa4-dd0dfca7f5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:33.307617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cfdcd9b2-67ed-49ad-8fa4-dd0dfca7f5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:33.336957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cfdcd9b2-67ed-49ad-8fa4-dd0dfca7f5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Jan 19 16:31:33.337519 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 510/1133] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:33.578829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b01017b0-e2d5-4fa8-ab42-d5a0321f6e7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:33.579690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b01017b0-e2d5-4fa8-ab42-d5a0321f6e7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:33.586013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01017b0-e2d5-4fa8-ab42-d5a0321f6e7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:33.586475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01017b0-e2d5-4fa8-ab42-d5a0321f6e7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:33.587251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01017b0-e2d5-4fa8-ab42-d5a0321f6e7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:33.587714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01017b0-e2d5-4fa8-ab42-d5a0321f6e7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:33.617190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b01017b0-e2d5-4fa8-ab42-d5a0321f6e7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Jan 19 16:31:33.617751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 624/1134] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:33.857118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:33.857648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:33.863532 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:33.864014 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:33.864793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:33.865232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:33.990840 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:33.999494 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:34.001030 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:34.002174 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f8d87740-683f-4343-89b5-d82633658d19 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.148862 Jan 19 16:31:34.002729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 511/1135] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:33 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:34.041783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:34.042387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:34.048239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:34.048685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:34.049459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:34.049888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:34.106960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:34.114889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d5095eaa-94f5-4a01-8a14-a76439ad548f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.076602 Jan 19 16:31:34.115402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 625/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:34 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:34.348339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5fe14d14-0804-4eeb-9277-911b2e7f78bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:34.349250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5fe14d14-0804-4eeb-9277-911b2e7f78bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:34.355457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fe14d14-0804-4eeb-9277-911b2e7f78bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:34.355943 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fe14d14-0804-4eeb-9277-911b2e7f78bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:34.356744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fe14d14-0804-4eeb-9277-911b2e7f78bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:34.357183 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fe14d14-0804-4eeb-9277-911b2e7f78bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:34.386239 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5fe14d14-0804-4eeb-9277-911b2e7f78bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Jan 19 16:31:34.386717 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 512/1137] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:34.630077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fb243e2f-f7c8-4733-ae0a-d9dd4b29428f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:34.631431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fb243e2f-f7c8-4733-ae0a-d9dd4b29428f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:34.638160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb243e2f-f7c8-4733-ae0a-d9dd4b29428f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:34.638547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb243e2f-f7c8-4733-ae0a-d9dd4b29428f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:34.639335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb243e2f-f7c8-4733-ae0a-d9dd4b29428f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:34.639813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb243e2f-f7c8-4733-ae0a-d9dd4b29428f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:34.670823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fb243e2f-f7c8-4733-ae0a-d9dd4b29428f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Jan 19 16:31:34.671391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 626/1138] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:35.020928 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:35.021528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:35.027444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.027927 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.028718 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.029154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.132400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:35.133149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:35.139730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.141277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.141277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.141544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.166106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:35.176639 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:35.178139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:35.179308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0b0a804b-f0e5-4dbe-93e3-469196a6b12d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162087 Jan 19 16:31:35.185262 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 513/1139] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:35 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:35.219009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:35.226533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-39e6c56c-e305-4315-b6c1-7604696fafba tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.097830 Jan 19 16:31:35.227104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 627/1140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:35 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:35.397828 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4307ffb3-98eb-4447-9c8d-df00cbafe8e3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:35.398693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4307ffb3-98eb-4447-9c8d-df00cbafe8e3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:35.405106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4307ffb3-98eb-4447-9c8d-df00cbafe8e3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.405564 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4307ffb3-98eb-4447-9c8d-df00cbafe8e3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.406353 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4307ffb3-98eb-4447-9c8d-df00cbafe8e3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.406839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4307ffb3-98eb-4447-9c8d-df00cbafe8e3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.438068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4307ffb3-98eb-4447-9c8d-df00cbafe8e3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Jan 19 16:31:35.438659 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 514/1141] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:35.682460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-591506e7-5f1a-4dbd-9ec9-72066708e6ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:35.683738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-591506e7-5f1a-4dbd-9ec9-72066708e6ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:35.690244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-591506e7-5f1a-4dbd-9ec9-72066708e6ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.690691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-591506e7-5f1a-4dbd-9ec9-72066708e6ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.691464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-591506e7-5f1a-4dbd-9ec9-72066708e6ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:35.691949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-591506e7-5f1a-4dbd-9ec9-72066708e6ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:35.719784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-591506e7-5f1a-4dbd-9ec9-72066708e6ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Jan 19 16:31:35.720463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 628/1142] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:36.197537 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:36.198142 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:36.204045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.204503 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.205282 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.205727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.243399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:36.244141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:36.250091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.250634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.251497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.252049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.315188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:36.322819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-01621184-dfa7-4f0a-8219-878efe997d3a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082914 Jan 19 16:31:36.323507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 629/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:36 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:36.360093 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:36.368584 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:36.370087 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:36.371236 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f18141e8-a0ba-4365-a289-2ac3cd3404bd tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.177443 Jan 19 16:31:36.372280 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 515/1144] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:36 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:36.449226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-07dfaff3-2d49-4052-ba5e-11847ac10050 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:36.450054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-07dfaff3-2d49-4052-ba5e-11847ac10050 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:36.456920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07dfaff3-2d49-4052-ba5e-11847ac10050 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.457377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07dfaff3-2d49-4052-ba5e-11847ac10050 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.458175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07dfaff3-2d49-4052-ba5e-11847ac10050 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.458623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07dfaff3-2d49-4052-ba5e-11847ac10050 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.489298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-07dfaff3-2d49-4052-ba5e-11847ac10050 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Jan 19 16:31:36.489862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 630/1145] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:36.731908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c4bead42-c845-48e3-9778-ef26b661d096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:36.733079 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c4bead42-c845-48e3-9778-ef26b661d096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:36.740621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c4bead42-c845-48e3-9778-ef26b661d096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.741184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c4bead42-c845-48e3-9778-ef26b661d096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.742064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c4bead42-c845-48e3-9778-ef26b661d096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:36.742600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c4bead42-c845-48e3-9778-ef26b661d096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:36.773384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c4bead42-c845-48e3-9778-ef26b661d096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Jan 19 16:31:36.773949 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 516/1146] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:37.339346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:37.339985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:37.346908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.347458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.348207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.348646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.390092 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:37.390854 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:37.396769 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.397299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.398160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.398693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.412758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:37.420049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b67c3011-5dd5-4db2-9360-b6bebc477feb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.084311 Jan 19 16:31:37.420823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 631/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:37 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:37.501453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a0d041c-ecd7-4a9f-9ebe-4b4c8f21ccb9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:37.502367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a0d041c-ecd7-4a9f-9ebe-4b4c8f21ccb9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:37.508259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a0d041c-ecd7-4a9f-9ebe-4b4c8f21ccb9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.508711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a0d041c-ecd7-4a9f-9ebe-4b4c8f21ccb9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.509490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a0d041c-ecd7-4a9f-9ebe-4b4c8f21ccb9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.509932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a0d041c-ecd7-4a9f-9ebe-4b4c8f21ccb9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.527957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:37.536919 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:37.538394 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:37.539522 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-457fb46a-a491-4591-a725-bee2532f661d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153622 Jan 19 16:31:37.540095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a0d041c-ecd7-4a9f-9ebe-4b4c8f21ccb9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Jan 19 16:31:37.540207 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 517/1148] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:37 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:31:37.540653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 632/1149] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:37.785118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cadc7d0d-91e2-44dc-a8b0-88db844a7acd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:37.786068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cadc7d0d-91e2-44dc-a8b0-88db844a7acd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:37.792395 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cadc7d0d-91e2-44dc-a8b0-88db844a7acd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.792849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cadc7d0d-91e2-44dc-a8b0-88db844a7acd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.793625 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cadc7d0d-91e2-44dc-a8b0-88db844a7acd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:37.794064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cadc7d0d-91e2-44dc-a8b0-88db844a7acd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:37.822935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cadc7d0d-91e2-44dc-a8b0-88db844a7acd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 Jan 19 16:31:37.823483 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 518/1150] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:38.435877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:38.436478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:38.443034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.443480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.444301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.444730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.511042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:38.518411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2c34d355-5e8c-437d-9cc4-6c2bde5435a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.086143 Jan 19 16:31:38.518971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 633/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:38 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:38.551159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0b93b0eb-ea6e-49aa-ade5-f8a40687fb29 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:38.552113 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0b93b0eb-ea6e-49aa-ade5-f8a40687fb29 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:38.557603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:38.557965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b93b0eb-ea6e-49aa-ade5-f8a40687fb29 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.558217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:38.558413 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b93b0eb-ea6e-49aa-ade5-f8a40687fb29 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.559183 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b93b0eb-ea6e-49aa-ade5-f8a40687fb29 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.559617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0b93b0eb-ea6e-49aa-ade5-f8a40687fb29 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.563994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.564453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.565243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.565734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.587767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0b93b0eb-ea6e-49aa-ade5-f8a40687fb29 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040244 Jan 19 16:31:38.588336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 519/1152] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:38.697937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:38.706715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:38.708240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:38.709396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f16670c6-7504-4e45-9dd5-6e5b2b493246 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155412 Jan 19 16:31:38.709954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 634/1153] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:38 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:31:38.835905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2478b0b8-36a3-4cf6-8dc0-32a9de95bdc6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:38.836743 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2478b0b8-36a3-4cf6-8dc0-32a9de95bdc6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:38.844250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2478b0b8-36a3-4cf6-8dc0-32a9de95bdc6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.844708 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2478b0b8-36a3-4cf6-8dc0-32a9de95bdc6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.845511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2478b0b8-36a3-4cf6-8dc0-32a9de95bdc6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:38.845954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2478b0b8-36a3-4cf6-8dc0-32a9de95bdc6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:38.875261 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2478b0b8-36a3-4cf6-8dc0-32a9de95bdc6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Jan 19 16:31:38.875867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 520/1154] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:39.534452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:39.535065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:39.541516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.542005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.542791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.543229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.598442 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-132f6ec3-ef44-4647-83f7-1b5663c0444b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:39.599422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-132f6ec3-ef44-4647-83f7-1b5663c0444b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:39.601460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:39.605620 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-132f6ec3-ef44-4647-83f7-1b5663c0444b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.606076 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-132f6ec3-ef44-4647-83f7-1b5663c0444b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.606867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-132f6ec3-ef44-4647-83f7-1b5663c0444b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.607308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-132f6ec3-ef44-4647-83f7-1b5663c0444b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.609159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b39a7a42-ec0b-4370-95d5-52dfc5280f31 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078649 Jan 19 16:31:39.609718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 635/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:39 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:39.637497 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-132f6ec3-ef44-4647-83f7-1b5663c0444b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042817 Jan 19 16:31:39.637952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 521/1156] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:39.728104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:39.728706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:39.735043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.735482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.736270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.736698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.865265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:39.873488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:39.875026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:39.876190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4033bcc-6cd2-41a7-8856-32e682d4cf93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151740 Jan 19 16:31:39.876748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 636/1157] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:39 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:39.886091 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1e4fc092-f4f3-4c7c-b513-f35da597c363 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:39.887032 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1e4fc092-f4f3-4c7c-b513-f35da597c363 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:39.893828 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e4fc092-f4f3-4c7c-b513-f35da597c363 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.894211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e4fc092-f4f3-4c7c-b513-f35da597c363 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.894990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e4fc092-f4f3-4c7c-b513-f35da597c363 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:39.895455 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1e4fc092-f4f3-4c7c-b513-f35da597c363 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:39.924829 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1e4fc092-f4f3-4c7c-b513-f35da597c363 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Jan 19 16:31:39.925378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 522/1158] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:40.626310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:40.626857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:40.633164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.633610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.634380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.634845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.649033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-942e7106-ba1e-4f85-9b34-cccaacd83d2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:40.649961 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-942e7106-ba1e-4f85-9b34-cccaacd83d2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:40.656310 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-942e7106-ba1e-4f85-9b34-cccaacd83d2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.657115 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-942e7106-ba1e-4f85-9b34-cccaacd83d2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.657319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-942e7106-ba1e-4f85-9b34-cccaacd83d2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.658745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-942e7106-ba1e-4f85-9b34-cccaacd83d2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.689740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-942e7106-ba1e-4f85-9b34-cccaacd83d2f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Jan 19 16:31:40.690326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 523/1159] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:40.697858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:40.705966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b855b8b1-7558-4f29-9478-6a012c638f50 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083905 Jan 19 16:31:40.706534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 637/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:40 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:40.894978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:40.895507 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:40.901818 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.902275 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.903062 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.903505 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.935236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-66960449-5401-475f-a046-5058fdf8f8ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:40.936857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-66960449-5401-475f-a046-5058fdf8f8ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:40.942875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66960449-5401-475f-a046-5058fdf8f8ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.943408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66960449-5401-475f-a046-5058fdf8f8ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.944293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66960449-5401-475f-a046-5058fdf8f8ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:40.944732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66960449-5401-475f-a046-5058fdf8f8ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:40.974290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-66960449-5401-475f-a046-5058fdf8f8ef tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042701 Jan 19 16:31:40.974913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 638/1161] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:41.034496 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:41.042726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:41.044256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:41.045398 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5c1f8c25-1d90-44e3-8b00-5e0feff1bd51 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154198 Jan 19 16:31:41.046479 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 524/1162] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:40 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:41.701347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-51522ddf-09f3-4a29-8f7b-629a27ddf9d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:41.702770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-51522ddf-09f3-4a29-8f7b-629a27ddf9d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:41.709283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51522ddf-09f3-4a29-8f7b-629a27ddf9d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:41.709728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51522ddf-09f3-4a29-8f7b-629a27ddf9d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:41.710499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51522ddf-09f3-4a29-8f7b-629a27ddf9d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:41.710958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51522ddf-09f3-4a29-8f7b-629a27ddf9d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:41.722609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:41.723217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:41.729599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:41.730051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:41.730838 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:41.731272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:41.741093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-51522ddf-09f3-4a29-8f7b-629a27ddf9d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Jan 19 16:31:41.741665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 639/1163] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:41.793085 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:41.800527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1391b745-ec56-4c91-a178-79f3f2af1dd2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081535 Jan 19 16:31:41.801103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 525/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:41 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:41.985870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f2ac1549-f52e-47af-ad77-4ff8afda5a8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:41.986806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f2ac1549-f52e-47af-ad77-4ff8afda5a8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:41.992859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2ac1549-f52e-47af-ad77-4ff8afda5a8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:41.993309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2ac1549-f52e-47af-ad77-4ff8afda5a8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:41.994087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2ac1549-f52e-47af-ad77-4ff8afda5a8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:41.994532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2ac1549-f52e-47af-ad77-4ff8afda5a8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:42.025175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f2ac1549-f52e-47af-ad77-4ff8afda5a8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043059 Jan 19 16:31:42.025748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 640/1165] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:42.065059 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:42.065711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:42.071795 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:42.072251 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:42.073106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:42.073572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:42.240402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:42.256343 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:42.258272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:42.260198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f93c45c7-c536-48b0-9c42-db48a4028bf9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.199170 Jan 19 16:31:42.261163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 526/1166] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:42 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:42.753384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-381d93b0-3938-421b-a571-d1fdf4deca22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:42.754327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-381d93b0-3938-421b-a571-d1fdf4deca22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:42.760630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-381d93b0-3938-421b-a571-d1fdf4deca22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:42.761086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-381d93b0-3938-421b-a571-d1fdf4deca22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:42.762026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-381d93b0-3938-421b-a571-d1fdf4deca22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:42.762583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-381d93b0-3938-421b-a571-d1fdf4deca22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:42.798257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-381d93b0-3938-421b-a571-d1fdf4deca22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049127 Jan 19 16:31:42.798850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 641/1167] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:42.817129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:42.817774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:42.824375 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:42.824826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:42.825626 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:42.826061 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:42.897658 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:42.906086 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-66cd4e62-5db0-4036-ab82-2ae07c4dbd16 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.092557 Jan 19 16:31:42.906694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 527/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:42 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:43.038921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d1a8cad7-863a-4e4b-9279-1776f9544b93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:43.040251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d1a8cad7-863a-4e4b-9279-1776f9544b93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:43.049329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1a8cad7-863a-4e4b-9279-1776f9544b93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.049929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1a8cad7-863a-4e4b-9279-1776f9544b93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:43.050874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1a8cad7-863a-4e4b-9279-1776f9544b93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.051423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1a8cad7-863a-4e4b-9279-1776f9544b93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:43.083044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d1a8cad7-863a-4e4b-9279-1776f9544b93 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048825 Jan 19 16:31:43.083627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 642/1169] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:43.288885 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:43.289550 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:43.295771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.296238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:43.297082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.297514 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:43.669330 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:43.678759 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:43.680627 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:43.682099 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-54b34c1d-ad91-4302-b9b5-1a2a590665e8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.398077 Jan 19 16:31:43.682767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 528/1170] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:43 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:43.810559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3d729be3-aa72-43ea-bb3e-1d49a8f9ee70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:43.812090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3d729be3-aa72-43ea-bb3e-1d49a8f9ee70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:43.818789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d729be3-aa72-43ea-bb3e-1d49a8f9ee70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.819236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d729be3-aa72-43ea-bb3e-1d49a8f9ee70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:43.820059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d729be3-aa72-43ea-bb3e-1d49a8f9ee70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.820494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d729be3-aa72-43ea-bb3e-1d49a8f9ee70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:43.856431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3d729be3-aa72-43ea-bb3e-1d49a8f9ee70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049274 Jan 19 16:31:43.857451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 643/1171] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:43.923691 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:43.924325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:43.933234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.933983 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:43.935311 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:43.936134 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:44.014687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:44.022629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-300192b3-af5c-4e91-8f12-2e8f78a6abe0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.103078 Jan 19 16:31:44.023226 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 529/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:43 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:44.095316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0c10ac62-3b12-45ad-bb89-f49b91b5781a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:44.096254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0c10ac62-3b12-45ad-bb89-f49b91b5781a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:44.102440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c10ac62-3b12-45ad-bb89-f49b91b5781a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:44.102897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c10ac62-3b12-45ad-bb89-f49b91b5781a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:44.103789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c10ac62-3b12-45ad-bb89-f49b91b5781a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:44.104247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c10ac62-3b12-45ad-bb89-f49b91b5781a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:44.134714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0c10ac62-3b12-45ad-bb89-f49b91b5781a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Jan 19 16:31:44.135211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 644/1173] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:44.707118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:44.707904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:44.714051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:44.714510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:44.715321 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:44.715798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:44.856567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:44.865866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:44.867364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:44.868571 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7388e02d-bbaf-481c-9c00-ec39cb02aaa1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165216 Jan 19 16:31:44.869134 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 530/1174] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:44 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:44.871165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-44393a19-26d3-40c9-befd-1a9d8bda5758 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:44.872877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-44393a19-26d3-40c9-befd-1a9d8bda5758 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:44.880895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44393a19-26d3-40c9-befd-1a9d8bda5758 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:44.881356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44393a19-26d3-40c9-befd-1a9d8bda5758 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:44.882153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44393a19-26d3-40c9-befd-1a9d8bda5758 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:44.882597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44393a19-26d3-40c9-befd-1a9d8bda5758 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:44.914572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-44393a19-26d3-40c9-befd-1a9d8bda5758 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047921 Jan 19 16:31:44.915168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 645/1175] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:45.040607 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:45.041221 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:45.048165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.048624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.049423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.049891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.113426 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:45.121334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f9c3e614-27e6-4fa4-bb68-7a850796766f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.084435 Jan 19 16:31:45.121923 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 531/1176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:45 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:45.146875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6331644-a48b-45c5-a115-50b7deaef624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:45.147845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6331644-a48b-45c5-a115-50b7deaef624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:45.154096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6331644-a48b-45c5-a115-50b7deaef624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.154539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6331644-a48b-45c5-a115-50b7deaef624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.155340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6331644-a48b-45c5-a115-50b7deaef624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.155816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6331644-a48b-45c5-a115-50b7deaef624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.189909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6331644-a48b-45c5-a115-50b7deaef624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Jan 19 16:31:45.190474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 646/1177] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:45.897852 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:45.898472 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:45.904664 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.905108 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.905895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.906328 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.929605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-25aaa900-9e1c-4e32-aafe-aeef6283d4ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:45.930559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-25aaa900-9e1c-4e32-aafe-aeef6283d4ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:45.937506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25aaa900-9e1c-4e32-aafe-aeef6283d4ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.937879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25aaa900-9e1c-4e32-aafe-aeef6283d4ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.938676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25aaa900-9e1c-4e32-aafe-aeef6283d4ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:45.939122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25aaa900-9e1c-4e32-aafe-aeef6283d4ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:45.980207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-25aaa900-9e1c-4e32-aafe-aeef6283d4ba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054475 Jan 19 16:31:45.985964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 647/1178] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:46.069553 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:46.079090 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:46.080676 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:46.081855 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d017bf97-22a2-4c4b-8928-a94435c3da43 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.187739 Jan 19 16:31:46.082418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 532/1179] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:45 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:46.143725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:46.144798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:46.154683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:46.155354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:46.156800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:46.157723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:46.206034 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d55df695-cc9e-43ab-8dd5-6cdb016fe073 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:46.207386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d55df695-cc9e-43ab-8dd5-6cdb016fe073 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:46.214606 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d55df695-cc9e-43ab-8dd5-6cdb016fe073 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:46.215049 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d55df695-cc9e-43ab-8dd5-6cdb016fe073 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:46.215890 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d55df695-cc9e-43ab-8dd5-6cdb016fe073 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:46.216327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d55df695-cc9e-43ab-8dd5-6cdb016fe073 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:46.246246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:46.251965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d55df695-cc9e-43ab-8dd5-6cdb016fe073 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052043 Jan 19 16:31:46.252560 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 533/1180] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:46.258745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0c384ca7-a7e7-4035-b6ad-4af6d57183a9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.121610 Jan 19 16:31:46.259335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 648/1181] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:46 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:46.993650 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-706d20ce-3c7e-44e5-97c9-2f1ef7776a7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:46.994745 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-706d20ce-3c7e-44e5-97c9-2f1ef7776a7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:47.001609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-706d20ce-3c7e-44e5-97c9-2f1ef7776a7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.002065 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-706d20ce-3c7e-44e5-97c9-2f1ef7776a7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.002866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-706d20ce-3c7e-44e5-97c9-2f1ef7776a7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.003301 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-706d20ce-3c7e-44e5-97c9-2f1ef7776a7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.036430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-706d20ce-3c7e-44e5-97c9-2f1ef7776a7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Jan 19 16:31:47.037136 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 534/1182] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:47.109615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:47.110430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:47.118055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.118604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.119543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.120046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.265798 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5add31f9-6a82-48a3-9c83-3fbbbed24705 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:47.267103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5add31f9-6a82-48a3-9c83-3fbbbed24705 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:47.274768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:47.275117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5add31f9-6a82-48a3-9c83-3fbbbed24705 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.275117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5add31f9-6a82-48a3-9c83-3fbbbed24705 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.276758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5add31f9-6a82-48a3-9c83-3fbbbed24705 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.277251 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5add31f9-6a82-48a3-9c83-3fbbbed24705 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.285764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:47.292746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:47.292746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-39632f38-7978-4199-9d39-2b9525621981 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.182735 Jan 19 16:31:47.292746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 649/1183] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:47 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:47.294799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:47.295222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:47.302055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.302518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.303313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:47.303777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:47.319429 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5add31f9-6a82-48a3-9c83-3fbbbed24705 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057657 Jan 19 16:31:47.320057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 535/1184] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:47.377920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:47.385895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5e2b1489-15ee-4701-aae3-4ad710881ed1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.095183 Jan 19 16:31:47.386469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 650/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:47 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:48.047535 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8dd40fd2-1c07-4cc2-aef0-5085c87b8401 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:48.048480 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8dd40fd2-1c07-4cc2-aef0-5085c87b8401 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:48.054733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8dd40fd2-1c07-4cc2-aef0-5085c87b8401 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.055196 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8dd40fd2-1c07-4cc2-aef0-5085c87b8401 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.056036 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8dd40fd2-1c07-4cc2-aef0-5085c87b8401 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.056484 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8dd40fd2-1c07-4cc2-aef0-5085c87b8401 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.089294 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8dd40fd2-1c07-4cc2-aef0-5085c87b8401 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Jan 19 16:31:48.089881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 536/1186] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:48.310348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:48.311393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:48.318043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.318496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.319296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.319767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.334591 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-00d7cd1c-f43b-4f04-a4ef-6e3166281935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:48.335504 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-00d7cd1c-f43b-4f04-a4ef-6e3166281935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:48.342640 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-00d7cd1c-f43b-4f04-a4ef-6e3166281935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.343097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-00d7cd1c-f43b-4f04-a4ef-6e3166281935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.343942 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-00d7cd1c-f43b-4f04-a4ef-6e3166281935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.344719 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-00d7cd1c-f43b-4f04-a4ef-6e3166281935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.375925 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-00d7cd1c-f43b-4f04-a4ef-6e3166281935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Jan 19 16:31:48.376520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 537/1187] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:48.402477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:48.403139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:48.409916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.410369 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.411164 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:48.411604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:48.505261 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:48.514582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:48.517733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-38f9e5b8-b15b-4019-8e33-3d39798873e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.118659 Jan 19 16:31:48.518725 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 538/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:48 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:31:48.526164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:48.528070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:48.529463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-003b7244-4f75-45b4-866e-6bd760e691f8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.223917 Jan 19 16:31:48.530342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 651/1189] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:48 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:49.101151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-57f05633-920a-4100-ac3b-cb8a097f4948 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:49.102074 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-57f05633-920a-4100-ac3b-cb8a097f4948 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:49.108271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57f05633-920a-4100-ac3b-cb8a097f4948 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.108735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57f05633-920a-4100-ac3b-cb8a097f4948 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.109547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57f05633-920a-4100-ac3b-cb8a097f4948 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.109988 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-57f05633-920a-4100-ac3b-cb8a097f4948 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.144297 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-57f05633-920a-4100-ac3b-cb8a097f4948 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Jan 19 16:31:49.144956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 539/1190] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:49.388540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c9b94f3e-f8a4-48b9-a0b7-6d0f470fe762 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:49.389389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c9b94f3e-f8a4-48b9-a0b7-6d0f470fe762 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:49.395778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9b94f3e-f8a4-48b9-a0b7-6d0f470fe762 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.396235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9b94f3e-f8a4-48b9-a0b7-6d0f470fe762 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.397019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9b94f3e-f8a4-48b9-a0b7-6d0f470fe762 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.397460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9b94f3e-f8a4-48b9-a0b7-6d0f470fe762 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.431736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c9b94f3e-f8a4-48b9-a0b7-6d0f470fe762 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Jan 19 16:31:49.432645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 652/1191] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:49.536974 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:49.537651 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:49.544712 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.545260 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.547321 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.547859 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.557270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:49.558040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:49.568366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.569156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.570341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:49.571018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:49.634207 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:49.648780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8ddfe57a-1c23-4647-a2e2-9b8d23053b33 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.114885 Jan 19 16:31:49.650079 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 540/1192] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:49 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:49.750523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:49.760385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:49.761949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:49.763180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-51ae7be2-5a73-40c6-8a14-363784a8d3ea tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.217464 Jan 19 16:31:49.763784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 653/1193] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:49 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:50.156548 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5fafd3af-6b64-47e3-94ac-3cd4d7d4492a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:50.157869 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5fafd3af-6b64-47e3-94ac-3cd4d7d4492a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:50.165323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fafd3af-6b64-47e3-94ac-3cd4d7d4492a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.165782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fafd3af-6b64-47e3-94ac-3cd4d7d4492a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.166583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fafd3af-6b64-47e3-94ac-3cd4d7d4492a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.167022 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5fafd3af-6b64-47e3-94ac-3cd4d7d4492a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.201024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5fafd3af-6b64-47e3-94ac-3cd4d7d4492a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049120 Jan 19 16:31:50.202286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 541/1194] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:50.444826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2f8647a4-02c0-442a-9792-79fd5e78c758 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:50.445655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2f8647a4-02c0-442a-9792-79fd5e78c758 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:50.452535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f8647a4-02c0-442a-9792-79fd5e78c758 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.452989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f8647a4-02c0-442a-9792-79fd5e78c758 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.453777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f8647a4-02c0-442a-9792-79fd5e78c758 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.454217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f8647a4-02c0-442a-9792-79fd5e78c758 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.483505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2f8647a4-02c0-442a-9792-79fd5e78c758 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042412 Jan 19 16:31:50.484100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 654/1195] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:50.669294 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:50.669906 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:50.676771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.677229 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.678024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.678462 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.743570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:50.751585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-63403981-b482-4388-8ade-0febf19f8ed3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085940 Jan 19 16:31:50.752186 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 542/1196] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:50 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:50.782001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:50.782886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:50.788673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.789119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.789878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:50.790307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:50.924027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:50.937458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:50.939001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:50.940796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-46baad8a-ce1b-4a29-8106-d244613a6e9f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162174 Jan 19 16:31:50.941826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 655/1197] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:50 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:51.213488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-33043912-7c5c-41c3-b4de-637786929ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:51.214419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-33043912-7c5c-41c3-b4de-637786929ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:51.221867 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33043912-7c5c-41c3-b4de-637786929ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.222318 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33043912-7c5c-41c3-b4de-637786929ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:51.223166 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33043912-7c5c-41c3-b4de-637786929ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.223609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-33043912-7c5c-41c3-b4de-637786929ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:51.253856 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-33043912-7c5c-41c3-b4de-637786929ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Jan 19 16:31:51.254431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 543/1198] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:51.495037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2c1164ba-bbc8-4951-992b-4c45e2ba55ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:51.495902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2c1164ba-bbc8-4951-992b-4c45e2ba55ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:51.502347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c1164ba-bbc8-4951-992b-4c45e2ba55ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.502798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c1164ba-bbc8-4951-992b-4c45e2ba55ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:51.503583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c1164ba-bbc8-4951-992b-4c45e2ba55ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.504053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c1164ba-bbc8-4951-992b-4c45e2ba55ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:51.534858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2c1164ba-bbc8-4951-992b-4c45e2ba55ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Jan 19 16:31:51.535423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 656/1199] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:51.768677 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:51.769196 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:51.775390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.775871 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:51.776642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.777072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:51.835920 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:51.843117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-66479b4f-eaeb-418e-8137-84b3216df7c7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078122 Jan 19 16:31:51.843699 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 544/1200] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:51 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:51.959345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:51.960009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:51.965936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.966383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:51.967163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:51.967597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:52.096706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:52.105103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:52.106612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:52.107825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4d27cc7-0e26-48ca-a821-d74f42fd4e38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152109 Jan 19 16:31:52.108388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 657/1201] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:51 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:52.264673 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5c46620f-7e54-4163-801c-0d5fd7a53259 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:52.265605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5c46620f-7e54-4163-801c-0d5fd7a53259 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:52.271754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c46620f-7e54-4163-801c-0d5fd7a53259 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:52.272201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c46620f-7e54-4163-801c-0d5fd7a53259 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:52.272966 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c46620f-7e54-4163-801c-0d5fd7a53259 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:52.273396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5c46620f-7e54-4163-801c-0d5fd7a53259 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:52.301806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5c46620f-7e54-4163-801c-0d5fd7a53259 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040807 Jan 19 16:31:52.302281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 545/1202] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:52.546695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-914a58d4-ef64-4c04-a806-cbd84e01980a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:52.547599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-914a58d4-ef64-4c04-a806-cbd84e01980a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:52.553908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-914a58d4-ef64-4c04-a806-cbd84e01980a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:52.554295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-914a58d4-ef64-4c04-a806-cbd84e01980a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:52.555083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-914a58d4-ef64-4c04-a806-cbd84e01980a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:52.555516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-914a58d4-ef64-4c04-a806-cbd84e01980a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:52.583210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-914a58d4-ef64-4c04-a806-cbd84e01980a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Jan 19 16:31:52.583777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 658/1203] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:52.860540 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:52.861061 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:52.867237 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:52.867695 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:52.868469 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:52.868896 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:52.931312 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:52.938765 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-16c165b7-9486-4e8e-a343-fbcdbf8175a7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082577 Jan 19 16:31:52.939325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 546/1204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:52 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:53.125981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:53.126494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:53.132596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.133048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:53.133826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.134266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:53.267992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:53.276513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:53.278016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:53.279171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9d6d70fe-1e87-4290-9407-235691cbc14f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156969 Jan 19 16:31:53.285449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 659/1205] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:53 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:53.313232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c3369485-6ca3-4a73-ae4d-008c991d17dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:53.314140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c3369485-6ca3-4a73-ae4d-008c991d17dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:53.320182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c3369485-6ca3-4a73-ae4d-008c991d17dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.320637 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c3369485-6ca3-4a73-ae4d-008c991d17dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:53.321428 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c3369485-6ca3-4a73-ae4d-008c991d17dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.321866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c3369485-6ca3-4a73-ae4d-008c991d17dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:53.351119 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c3369485-6ca3-4a73-ae4d-008c991d17dd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 Jan 19 16:31:53.351687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 547/1206] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:53.594683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-657922d4-9f98-412e-a2d3-7457245d1216 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:53.595584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-657922d4-9f98-412e-a2d3-7457245d1216 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:53.602232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657922d4-9f98-412e-a2d3-7457245d1216 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.602692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657922d4-9f98-412e-a2d3-7457245d1216 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:53.603474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657922d4-9f98-412e-a2d3-7457245d1216 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.603945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-657922d4-9f98-412e-a2d3-7457245d1216 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:53.632562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-657922d4-9f98-412e-a2d3-7457245d1216 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 Jan 19 16:31:53.633126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 660/1207] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:53.955247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:53.955898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:53.962278 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.962732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:53.963521 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:53.963989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:54.022727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:54.030566 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3b4198c3-4702-4f7f-8601-a420fc7b5866 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078998 Jan 19 16:31:54.031128 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 548/1208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:53 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:54.299296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:54.299850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:54.305683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:54.306132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:54.306897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:54.307326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:54.362942 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c5c1e6c1-9876-4b92-b02b-77b3e4833388 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:54.363891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c5c1e6c1-9876-4b92-b02b-77b3e4833388 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:54.369807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5c1e6c1-9876-4b92-b02b-77b3e4833388 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:54.370722 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5c1e6c1-9876-4b92-b02b-77b3e4833388 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:54.371529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5c1e6c1-9876-4b92-b02b-77b3e4833388 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:54.372007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c5c1e6c1-9876-4b92-b02b-77b3e4833388 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:54.402832 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c5c1e6c1-9876-4b92-b02b-77b3e4833388 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043631 Jan 19 16:31:54.403419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 549/1209] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:54.449527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:54.459185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:54.460758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:54.461939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4e9e1b4-86b5-44cf-9095-a903320fd92d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.166954 Jan 19 16:31:54.462501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 661/1210] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:54 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:54.645438 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7e58d010-99bc-4bba-8d78-e91d27ca3f18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:54.646270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7e58d010-99bc-4bba-8d78-e91d27ca3f18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:54.655711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e58d010-99bc-4bba-8d78-e91d27ca3f18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:54.656176 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e58d010-99bc-4bba-8d78-e91d27ca3f18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:54.656987 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e58d010-99bc-4bba-8d78-e91d27ca3f18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:54.657686 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7e58d010-99bc-4bba-8d78-e91d27ca3f18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:54.691105 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7e58d010-99bc-4bba-8d78-e91d27ca3f18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050003 Jan 19 16:31:54.695156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 550/1211] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:55.047479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:55.048124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:55.054893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.055340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.056155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.056756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.118595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:55.126920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f6f954df-d618-49bf-93f5-c756436922aa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083287 Jan 19 16:31:55.127494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 662/1212] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:55 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:55.414810 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b0327ae6-e869-4684-8e18-250c89a5f6e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:55.415643 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b0327ae6-e869-4684-8e18-250c89a5f6e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:55.422729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0327ae6-e869-4684-8e18-250c89a5f6e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.423182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0327ae6-e869-4684-8e18-250c89a5f6e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.424026 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0327ae6-e869-4684-8e18-250c89a5f6e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.424465 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0327ae6-e869-4684-8e18-250c89a5f6e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.455381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b0327ae6-e869-4684-8e18-250c89a5f6e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Jan 19 16:31:55.455993 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 551/1213] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:55.481878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:55.483081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:55.489288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.489747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.490562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.491201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.627618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:55.636270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:55.637755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:55.638915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5f8a35ba-8e38-45e6-8686-55c9fe55ca88 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.160762 Jan 19 16:31:55.639476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 663/1214] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:55 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:55.702428 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e0e02785-990d-459c-ad99-2cacee410480 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:55.703333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e0e02785-990d-459c-ad99-2cacee410480 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:55.709260 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e0e02785-990d-459c-ad99-2cacee410480 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.709701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e0e02785-990d-459c-ad99-2cacee410480 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.710477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e0e02785-990d-459c-ad99-2cacee410480 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:55.710903 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e0e02785-990d-459c-ad99-2cacee410480 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:55.741618 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e0e02785-990d-459c-ad99-2cacee410480 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042956 Jan 19 16:31:55.742174 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 552/1215] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:56.144730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:56.145869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:56.152139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.152598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.153399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.153846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.215851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:56.224557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f6e037b-2928-4d58-b9a4-d0c23c708df7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083794 Jan 19 16:31:56.225137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 664/1216] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:56 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:56.466191 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-75664108-513f-4fef-ada7-f9f7d0fffda3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:56.467225 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-75664108-513f-4fef-ada7-f9f7d0fffda3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:56.474176 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-75664108-513f-4fef-ada7-f9f7d0fffda3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.474724 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-75664108-513f-4fef-ada7-f9f7d0fffda3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.475898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-75664108-513f-4fef-ada7-f9f7d0fffda3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.476234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-75664108-513f-4fef-ada7-f9f7d0fffda3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.507923 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-75664108-513f-4fef-ada7-f9f7d0fffda3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Jan 19 16:31:56.508529 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 553/1217] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:56.657973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:56.658508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:56.664674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.665124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.665951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.666369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.753990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-73ce8852-183a-4200-a4e0-1a92e7b0aac4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:56.754821 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-73ce8852-183a-4200-a4e0-1a92e7b0aac4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:56.770256 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73ce8852-183a-4200-a4e0-1a92e7b0aac4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.771047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73ce8852-183a-4200-a4e0-1a92e7b0aac4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.772480 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73ce8852-183a-4200-a4e0-1a92e7b0aac4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:56.773274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-73ce8852-183a-4200-a4e0-1a92e7b0aac4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:56.813858 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-73ce8852-183a-4200-a4e0-1a92e7b0aac4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063629 Jan 19 16:31:56.814476 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 554/1218] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:31:56.817881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:56.826283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:56.827795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:56.828936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3562637b-b3e3-4e7a-a776-e3f5e59266ff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.175104 Jan 19 16:31:56.829476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 665/1219] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:56 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:57.241767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:57.242380 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:57.248331 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.248790 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.249577 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.250015 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.310904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:57.318398 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a73f0a23-0c46-4616-9915-794db7670b93 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080489 Jan 19 16:31:57.319071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 555/1220] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:57 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:57.523047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20d7faf1-c0b1-4a09-9fd7-36ff8caa68de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:57.523952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20d7faf1-c0b1-4a09-9fd7-36ff8caa68de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:57.531706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20d7faf1-c0b1-4a09-9fd7-36ff8caa68de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.532566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20d7faf1-c0b1-4a09-9fd7-36ff8caa68de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.533490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20d7faf1-c0b1-4a09-9fd7-36ff8caa68de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.534032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20d7faf1-c0b1-4a09-9fd7-36ff8caa68de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.566089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20d7faf1-c0b1-4a09-9fd7-36ff8caa68de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Jan 19 16:31:57.566680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 666/1221] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:57.828880 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4996a086-b4f9-4433-b06e-56c9d97603fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:57.830452 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4996a086-b4f9-4433-b06e-56c9d97603fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:57.838995 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4996a086-b4f9-4433-b06e-56c9d97603fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.839449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4996a086-b4f9-4433-b06e-56c9d97603fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.840298 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4996a086-b4f9-4433-b06e-56c9d97603fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.840744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4996a086-b4f9-4433-b06e-56c9d97603fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.847356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:57.848007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:57.854494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.855174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.856368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:57.857167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:57.872488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4996a086-b4f9-4433-b06e-56c9d97603fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050665 Jan 19 16:31:57.873941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 556/1222] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:58.011391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:58.020694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:58.022217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:58.023408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b5145e5a-2e35-406b-921a-8813cbff739a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.180684 Jan 19 16:31:58.024104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 667/1223] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:57 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:31:58.335870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:58.336486 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:58.342552 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:58.347334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:58.347334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:58.347334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:58.410082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:58.417644 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-59bc5ae8-145e-48cc-b19f-25eafb2b2a18 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085477 Jan 19 16:31:58.418223 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 557/1224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:58 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:58.578226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-02c5cf23-c630-43f4-a87b-b84f3c5a7e7c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:58.579062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-02c5cf23-c630-43f4-a87b-b84f3c5a7e7c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:58.585666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c5cf23-c630-43f4-a87b-b84f3c5a7e7c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:58.586128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c5cf23-c630-43f4-a87b-b84f3c5a7e7c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:58.586963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c5cf23-c630-43f4-a87b-b84f3c5a7e7c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:58.587452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c5cf23-c630-43f4-a87b-b84f3c5a7e7c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:58.618881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-02c5cf23-c630-43f4-a87b-b84f3c5a7e7c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Jan 19 16:31:58.619463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 668/1225] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:58.886486 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ea5256c4-3369-4974-8c80-f4c84f522e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:58.887407 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ea5256c4-3369-4974-8c80-f4c84f522e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:58.894417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5256c4-3369-4974-8c80-f4c84f522e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:58.894869 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5256c4-3369-4974-8c80-f4c84f522e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:58.895687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5256c4-3369-4974-8c80-f4c84f522e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:58.896146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ea5256c4-3369-4974-8c80-f4c84f522e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:58.928127 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ea5256c4-3369-4974-8c80-f4c84f522e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047284 Jan 19 16:31:58.928723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 558/1226] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:59.042508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:59.043124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:59.049152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.049605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.050405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.050844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.186475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:59.195647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:59.197276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:59.198470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-62f5abd1-18f1-4bd2-8601-2b73488ecb6d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159848 Jan 19 16:31:59.199106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 669/1227] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:31:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:31:59.434360 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:59.434889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:59.441486 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.441945 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.442737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.443175 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.504194 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:31:59.511840 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-974b1741-fd8c-483a-8c7f-66504a4641e1 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081223 Jan 19 16:31:59.512418 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 559/1228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:31:59 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:31:59.630537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b653e373-d7d4-487b-8140-d348312002ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:59.631451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b653e373-d7d4-487b-8140-d348312002ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:59.638161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b653e373-d7d4-487b-8140-d348312002ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.639281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b653e373-d7d4-487b-8140-d348312002ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.640208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b653e373-d7d4-487b-8140-d348312002ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.640655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b653e373-d7d4-487b-8140-d348312002ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.673444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b653e373-d7d4-487b-8140-d348312002ee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046597 Jan 19 16:31:59.674039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 670/1229] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:31:59.940547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5271e2d4-fcc4-4e0d-9367-cb5e77478499 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:31:59.941514 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5271e2d4-fcc4-4e0d-9367-cb5e77478499 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:31:59.948429 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5271e2d4-fcc4-4e0d-9367-cb5e77478499 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.948882 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5271e2d4-fcc4-4e0d-9367-cb5e77478499 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.949680 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5271e2d4-fcc4-4e0d-9367-cb5e77478499 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:31:59.950119 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5271e2d4-fcc4-4e0d-9367-cb5e77478499 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:31:59.980800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5271e2d4-fcc4-4e0d-9367-cb5e77478499 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Jan 19 16:31:59.981383 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 560/1230] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:31:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:00.218074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:00.218691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:00.225419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:00.225878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:00.226768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:00.227211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:00.367251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:00.376839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:00.378313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:00.379458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d62aaa78-11e6-45b9-84a6-795a78a4fdf2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165715 Jan 19 16:32:00.380047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 671/1231] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:00 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:00.529917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:00.530509 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:00.536961 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:00.537412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:00.538211 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:00.538648 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:00.620067 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:00.627864 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-916a0e9e-f305-4a72-9037-a9be33d61d12 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.102354 Jan 19 16:32:00.628446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 561/1232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:00 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:00.685059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-74b963d4-cff0-4cb5-a67c-099f4811cfd3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:00.686002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-74b963d4-cff0-4cb5-a67c-099f4811cfd3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:00.692259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74b963d4-cff0-4cb5-a67c-099f4811cfd3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:00.692707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74b963d4-cff0-4cb5-a67c-099f4811cfd3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:00.693558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74b963d4-cff0-4cb5-a67c-099f4811cfd3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:00.693993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74b963d4-cff0-4cb5-a67c-099f4811cfd3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:00.724726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-74b963d4-cff0-4cb5-a67c-099f4811cfd3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Jan 19 16:32:00.725298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 672/1233] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:00.993669 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-678565c4-fa26-46be-9cd7-55e9259fd226 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:00.994639 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-678565c4-fa26-46be-9cd7-55e9259fd226 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:01.003594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678565c4-fa26-46be-9cd7-55e9259fd226 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.004082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678565c4-fa26-46be-9cd7-55e9259fd226 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.004886 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678565c4-fa26-46be-9cd7-55e9259fd226 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.005329 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678565c4-fa26-46be-9cd7-55e9259fd226 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.037582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-678565c4-fa26-46be-9cd7-55e9259fd226 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047739 Jan 19 16:32:01.038160 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 562/1234] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:01.399432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:01.399989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:01.407016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.407751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.408555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.408990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.546964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:01.556069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:01.557632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:01.558978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09eea8c4-0573-4d0e-afbd-1aca7523aa6a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163437 Jan 19 16:32:01.559546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 673/1235] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:01.645918 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:01.646721 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:01.653058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.653437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.654309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.654750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.716451 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:01.724352 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1c7f7c24-254b-48ed-a416-c0787f13699b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081962 Jan 19 16:32:01.724943 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 563/1236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:01 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:01.736284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76c83ef4-6922-44b1-9b61-3cf3db95a4ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:01.737195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76c83ef4-6922-44b1-9b61-3cf3db95a4ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:01.744875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c83ef4-6922-44b1-9b61-3cf3db95a4ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.745309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c83ef4-6922-44b1-9b61-3cf3db95a4ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.746092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c83ef4-6922-44b1-9b61-3cf3db95a4ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:01.746526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c83ef4-6922-44b1-9b61-3cf3db95a4ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:01.782781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76c83ef4-6922-44b1-9b61-3cf3db95a4ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049942 Jan 19 16:32:01.783360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 674/1237] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:02.048735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-65581bac-4c92-4b94-a7f3-48baf857be90 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:02.049660 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-65581bac-4c92-4b94-a7f3-48baf857be90 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:02.056129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-65581bac-4c92-4b94-a7f3-48baf857be90 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.056582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-65581bac-4c92-4b94-a7f3-48baf857be90 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.057370 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-65581bac-4c92-4b94-a7f3-48baf857be90 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.057808 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-65581bac-4c92-4b94-a7f3-48baf857be90 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.089088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-65581bac-4c92-4b94-a7f3-48baf857be90 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Jan 19 16:32:02.089642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 564/1238] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:02.580444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:02.580944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:02.587417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.587900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.588704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.589149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.741470 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:02.741960 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:02.745729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:02.748148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.748594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.749381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.749818 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.761103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:02.764622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:02.766806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-528c2247-c691-49cd-817d-4fa03873b32e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.189829 Jan 19 16:32:02.768389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 675/1239] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:02 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:02.795145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d25d4cb-042a-4d34-a935-a209f2e05b9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:02.796123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d25d4cb-042a-4d34-a935-a209f2e05b9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:02.803727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d25d4cb-042a-4d34-a935-a209f2e05b9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.804192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d25d4cb-042a-4d34-a935-a209f2e05b9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.804988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d25d4cb-042a-4d34-a935-a209f2e05b9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:02.805426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d25d4cb-042a-4d34-a935-a209f2e05b9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:02.812782 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:02.820702 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-accfa9d4-8e5f-4d9a-864b-9d5c03fcb172 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082975 Jan 19 16:32:02.821495 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 565/1240] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:02 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:02.839021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d25d4cb-042a-4d34-a935-a209f2e05b9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047536 Jan 19 16:32:02.839498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 676/1241] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:03.100412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b0fd1988-058e-4434-ad3f-19ad3c9ff096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:03.101259 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b0fd1988-058e-4434-ad3f-19ad3c9ff096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:03.107916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0fd1988-058e-4434-ad3f-19ad3c9ff096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.108372 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0fd1988-058e-4434-ad3f-19ad3c9ff096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.109167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0fd1988-058e-4434-ad3f-19ad3c9ff096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.109609 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b0fd1988-058e-4434-ad3f-19ad3c9ff096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.140476 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b0fd1988-058e-4434-ad3f-19ad3c9ff096 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Jan 19 16:32:03.141037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 566/1242] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:03.786545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:03.787215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:03.793757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.794405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.795965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.796500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.837945 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:03.838557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:03.846477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.847009 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.848053 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.848582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.915116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:03.924689 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3f9b6b9d-7f4b-4a62-8601-5860eaa010ff tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.090318 Jan 19 16:32:03.925313 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 567/1243] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:03 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:03.930274 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-678a5d1f-f235-4a98-ab77-8d245578e27e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:03.931189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-678a5d1f-f235-4a98-ab77-8d245578e27e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:03.938056 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678a5d1f-f235-4a98-ab77-8d245578e27e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.938673 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678a5d1f-f235-4a98-ab77-8d245578e27e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.939468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678a5d1f-f235-4a98-ab77-8d245578e27e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:03.939927 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-678a5d1f-f235-4a98-ab77-8d245578e27e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:03.957758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:03.966966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:03.968542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:03.969734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4a8e7d00-55b9-493d-a973-b7d93f119972 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.187304 Jan 19 16:32:03.970297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 677/1244] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:03 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:03.974155 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-678a5d1f-f235-4a98-ab77-8d245578e27e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Jan 19 16:32:03.974155 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 568/1245] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:04.152065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76f45fa8-aa20-41a6-b86f-ebce0264f68a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:04.152983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76f45fa8-aa20-41a6-b86f-ebce0264f68a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:04.165427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76f45fa8-aa20-41a6-b86f-ebce0264f68a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:04.165927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76f45fa8-aa20-41a6-b86f-ebce0264f68a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:04.166762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76f45fa8-aa20-41a6-b86f-ebce0264f68a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:04.167201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76f45fa8-aa20-41a6-b86f-ebce0264f68a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:04.198791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76f45fa8-aa20-41a6-b86f-ebce0264f68a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050471 Jan 19 16:32:04.199373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 678/1246] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:04.942402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:04.943250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:04.949573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:04.950011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:04.950930 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:04.950930 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:04.987785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b88d8e9b-dfa2-4199-b34a-b2c55f40ee84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:04.989209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b88d8e9b-dfa2-4199-b34a-b2c55f40ee84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:04.997109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b88d8e9b-dfa2-4199-b34a-b2c55f40ee84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:04.998326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b88d8e9b-dfa2-4199-b34a-b2c55f40ee84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:04.999469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b88d8e9b-dfa2-4199-b34a-b2c55f40ee84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:05.000100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b88d8e9b-dfa2-4199-b34a-b2c55f40ee84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:05.036203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b88d8e9b-dfa2-4199-b34a-b2c55f40ee84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054460 Jan 19 16:32:05.036844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 679/1247] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:05.041422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:05.042034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:05.049124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:05.049570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:05.050365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:05.050800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:05.181253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:05.189701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-505ec15f-b31b-44a8-9c72-89a25fa023b3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.250974 Jan 19 16:32:05.190401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 569/1248] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:04 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:05.210307 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bb2cbeac-8a4f-472a-acde-aec3ccdbc589 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:05.211231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bb2cbeac-8a4f-472a-acde-aec3ccdbc589 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:05.217103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bb2cbeac-8a4f-472a-acde-aec3ccdbc589 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:05.217564 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bb2cbeac-8a4f-472a-acde-aec3ccdbc589 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:05.217674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:05.218356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bb2cbeac-8a4f-472a-acde-aec3ccdbc589 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:05.218961 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bb2cbeac-8a4f-472a-acde-aec3ccdbc589 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:05.226788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:05.228309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:05.229457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-50fcdc87-9df6-456e-8ece-75d9d1dcdde4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.191690 Jan 19 16:32:05.230023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 680/1249] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:05 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:05.249937 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bb2cbeac-8a4f-472a-acde-aec3ccdbc589 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Jan 19 16:32:05.250510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 570/1250] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:06.049397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-384695f1-94dd-4cef-b825-b34569fed802 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:06.050351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-384695f1-94dd-4cef-b825-b34569fed802 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:06.056771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-384695f1-94dd-4cef-b825-b34569fed802 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.057223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-384695f1-94dd-4cef-b825-b34569fed802 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.058127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-384695f1-94dd-4cef-b825-b34569fed802 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.058446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-384695f1-94dd-4cef-b825-b34569fed802 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.089095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-384695f1-94dd-4cef-b825-b34569fed802 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043461 Jan 19 16:32:06.089668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 681/1251] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:06.207373 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:06.208001 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:06.214279 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.214733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.215513 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.215989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.248617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:06.249229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:06.257352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.257352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.257352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.257352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.275198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:06.282790 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-dde72dab-7fdf-4355-8676-1f06f34c24a4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078745 Jan 19 16:32:06.283351 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 571/1252] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:06 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:06.288379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0be31a32-e10d-41d5-ad0e-3ab0867b360a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:06.289285 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0be31a32-e10d-41d5-ad0e-3ab0867b360a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:06.295743 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0be31a32-e10d-41d5-ad0e-3ab0867b360a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.296204 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0be31a32-e10d-41d5-ad0e-3ab0867b360a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.296998 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0be31a32-e10d-41d5-ad0e-3ab0867b360a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:06.297433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0be31a32-e10d-41d5-ad0e-3ab0867b360a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:06.330501 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0be31a32-e10d-41d5-ad0e-3ab0867b360a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Jan 19 16:32:06.330501 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 572/1253] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:06.399706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:06.408306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:06.409840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:06.411022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e540b9f6-dc92-46bd-9f86-e3c4b14c6c84 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.166599 Jan 19 16:32:06.411574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 682/1254] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:06 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:07.099736 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-07f43473-ca86-4e97-9bff-e892ea0ca6f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:07.100677 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-07f43473-ca86-4e97-9bff-e892ea0ca6f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:07.106564 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07f43473-ca86-4e97-9bff-e892ea0ca6f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.107597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07f43473-ca86-4e97-9bff-e892ea0ca6f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.108397 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07f43473-ca86-4e97-9bff-e892ea0ca6f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.108835 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07f43473-ca86-4e97-9bff-e892ea0ca6f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.136718 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-07f43473-ca86-4e97-9bff-e892ea0ca6f8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040786 Jan 19 16:32:07.137252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 573/1255] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:07.298795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:07.299402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:07.306268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.306720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.307510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.307977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.345993 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a1d7f98c-4134-4085-bfa1-c1dd83930d15 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:07.346908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a1d7f98c-4134-4085-bfa1-c1dd83930d15 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:07.353607 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1d7f98c-4134-4085-bfa1-c1dd83930d15 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.353970 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1d7f98c-4134-4085-bfa1-c1dd83930d15 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.354764 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1d7f98c-4134-4085-bfa1-c1dd83930d15 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.355241 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1d7f98c-4134-4085-bfa1-c1dd83930d15 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.370100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:07.377829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4ca9581e-d071-4252-ab9c-cdf46f830e55 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082545 Jan 19 16:32:07.378486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 683/1256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:07 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:07.386474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a1d7f98c-4134-4085-bfa1-c1dd83930d15 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Jan 19 16:32:07.387031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 574/1257] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:07.429685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:07.430337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:07.436670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.437126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.437916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:07.438351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:07.565432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:07.573520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:07.574990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:07.576773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-60c03297-cf14-42ba-b3b4-fb145b806ce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150800 Jan 19 16:32:07.577398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 684/1258] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:08.148474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-05b462f8-140e-45fe-8710-d9c923fe0b39 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:08.149364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-05b462f8-140e-45fe-8710-d9c923fe0b39 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:08.155228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-05b462f8-140e-45fe-8710-d9c923fe0b39 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.155693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-05b462f8-140e-45fe-8710-d9c923fe0b39 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.156466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-05b462f8-140e-45fe-8710-d9c923fe0b39 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.156895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-05b462f8-140e-45fe-8710-d9c923fe0b39 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.185251 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-05b462f8-140e-45fe-8710-d9c923fe0b39 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040441 Jan 19 16:32:08.186299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 575/1259] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:08.394042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:08.394658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:08.398272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-eb87c8de-890d-43ef-aca7-65a569d295d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:08.399238 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-eb87c8de-890d-43ef-aca7-65a569d295d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:08.401173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.401631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.402434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.402874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.406071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb87c8de-890d-43ef-aca7-65a569d295d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.406519 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb87c8de-890d-43ef-aca7-65a569d295d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.407547 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb87c8de-890d-43ef-aca7-65a569d295d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.408010 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eb87c8de-890d-43ef-aca7-65a569d295d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.438430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-eb87c8de-890d-43ef-aca7-65a569d295d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 Jan 19 16:32:08.439015 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 576/1260] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:08.463831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:08.471962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-713e1f9b-0bd5-4595-85de-2bc0cc544c06 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081463 Jan 19 16:32:08.472712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 685/1261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:08 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:08.595252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:08.595892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:08.601879 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.602331 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.603106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:08.603537 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:08.737877 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:08.746171 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:08.747652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:08.748830 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1adce53f-0ae0-4136-a215-99bb2d98cf89 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157817 Jan 19 16:32:08.749380 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 577/1262] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:08 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:09.197008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9ac9b21d-7a51-4124-8a04-4369abd8384f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:09.197911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9ac9b21d-7a51-4124-8a04-4369abd8384f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:09.204444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ac9b21d-7a51-4124-8a04-4369abd8384f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.204892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ac9b21d-7a51-4124-8a04-4369abd8384f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.205682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ac9b21d-7a51-4124-8a04-4369abd8384f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.206100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ac9b21d-7a51-4124-8a04-4369abd8384f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.234476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9ac9b21d-7a51-4124-8a04-4369abd8384f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Jan 19 16:32:09.235035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 686/1263] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:09.449904 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-eca2f950-1da7-4081-af56-e0093533f4e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:09.450860 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-eca2f950-1da7-4081-af56-e0093533f4e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:09.456865 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eca2f950-1da7-4081-af56-e0093533f4e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.457322 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eca2f950-1da7-4081-af56-e0093533f4e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.458135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eca2f950-1da7-4081-af56-e0093533f4e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.458573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-eca2f950-1da7-4081-af56-e0093533f4e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.488314 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-eca2f950-1da7-4081-af56-e0093533f4e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Jan 19 16:32:09.488537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:09.488984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 578/1264] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:09.489086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:09.495164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.495607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.496405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.496835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.554853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:09.562751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3b96764b-cc9a-45f0-8607-557eabd9ace9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077859 Jan 19 16:32:09.563306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 687/1265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:09 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:09.766433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:09.766992 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:09.773068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.773524 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.774308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:09.774746 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:09.901360 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:09.910308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:09.911806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:09.912931 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7ffad501-4829-4c64-b14b-0778251e1570 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150333 Jan 19 16:32:09.913474 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 579/1266] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:09 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:10.245884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d0b6e2f6-885b-4d7d-b4db-37e6dfb0afa4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:10.246812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0b6e2f6-885b-4d7d-b4db-37e6dfb0afa4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:10.252795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0b6e2f6-885b-4d7d-b4db-37e6dfb0afa4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.253257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0b6e2f6-885b-4d7d-b4db-37e6dfb0afa4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:10.254041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0b6e2f6-885b-4d7d-b4db-37e6dfb0afa4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.254487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0b6e2f6-885b-4d7d-b4db-37e6dfb0afa4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:10.284073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d0b6e2f6-885b-4d7d-b4db-37e6dfb0afa4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041913 Jan 19 16:32:10.284638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 688/1267] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:10.498627 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5659f2cd-6b91-4173-972b-6cc4dbcb0bb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:10.499475 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5659f2cd-6b91-4173-972b-6cc4dbcb0bb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:10.505868 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5659f2cd-6b91-4173-972b-6cc4dbcb0bb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.506323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5659f2cd-6b91-4173-972b-6cc4dbcb0bb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:10.507118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5659f2cd-6b91-4173-972b-6cc4dbcb0bb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.507553 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5659f2cd-6b91-4173-972b-6cc4dbcb0bb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:10.537660 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5659f2cd-6b91-4173-972b-6cc4dbcb0bb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 Jan 19 16:32:10.538225 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 580/1268] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:10.578599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:10.579207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:10.585592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.586042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:10.586833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.587270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:10.649646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:10.657634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-348554aa-4cd5-43c5-9728-8ca48f469602 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082916 Jan 19 16:32:10.658206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 689/1269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:10 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:10.931780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:10.932308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:10.939111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.939567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:10.940394 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:10.940837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:11.069147 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:11.077344 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:11.078817 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:11.079982 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a955175c-12b5-4772-8656-7c1006b015a7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152013 Jan 19 16:32:11.080534 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 581/1270] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:10 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:11.296020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6602847b-30e4-4bb4-9220-8c2975d7d69e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:11.296958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6602847b-30e4-4bb4-9220-8c2975d7d69e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:11.302802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6602847b-30e4-4bb4-9220-8c2975d7d69e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:11.303256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6602847b-30e4-4bb4-9220-8c2975d7d69e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:11.304069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6602847b-30e4-4bb4-9220-8c2975d7d69e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:11.304505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6602847b-30e4-4bb4-9220-8c2975d7d69e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:11.332838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6602847b-30e4-4bb4-9220-8c2975d7d69e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041220 Jan 19 16:32:11.333400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 690/1271] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:11.549737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-592cec57-04c4-4b7e-85fd-5774c5b1ff91 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:11.550572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-592cec57-04c4-4b7e-85fd-5774c5b1ff91 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:11.556872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-592cec57-04c4-4b7e-85fd-5774c5b1ff91 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:11.557331 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-592cec57-04c4-4b7e-85fd-5774c5b1ff91 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:11.558111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-592cec57-04c4-4b7e-85fd-5774c5b1ff91 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:11.558554 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-592cec57-04c4-4b7e-85fd-5774c5b1ff91 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:11.586468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-592cec57-04c4-4b7e-85fd-5774c5b1ff91 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040581 Jan 19 16:32:11.587026 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 582/1272] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:11.676029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:11.676675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:11.683061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:11.683519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:11.684338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:11.684778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:11.750240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:11.757578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-36405b68-fdbe-4713-87c0-32be9f30dc36 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085201 Jan 19 16:32:11.758133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 691/1273] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:11 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:12.098164 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:12.098802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:12.104828 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.105281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.106069 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.106511 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.242533 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:12.252129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:12.253663 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:12.254828 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-edb8095d-afc6-41c5-892f-661165dca5f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.160345 Jan 19 16:32:12.255379 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 583/1274] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:12.343729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-98db6d97-2dae-4110-bd02-4a54f4b01687 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:12.344683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-98db6d97-2dae-4110-bd02-4a54f4b01687 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:12.350912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98db6d97-2dae-4110-bd02-4a54f4b01687 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.351285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98db6d97-2dae-4110-bd02-4a54f4b01687 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.352094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98db6d97-2dae-4110-bd02-4a54f4b01687 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.352527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98db6d97-2dae-4110-bd02-4a54f4b01687 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.383644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-98db6d97-2dae-4110-bd02-4a54f4b01687 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Jan 19 16:32:12.384293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 692/1275] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:12.597804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-40b4fd6b-aa0d-4c47-8131-3d66fd65ad97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:12.598732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-40b4fd6b-aa0d-4c47-8131-3d66fd65ad97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:12.604997 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40b4fd6b-aa0d-4c47-8131-3d66fd65ad97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.605377 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40b4fd6b-aa0d-4c47-8131-3d66fd65ad97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.606140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40b4fd6b-aa0d-4c47-8131-3d66fd65ad97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.606566 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-40b4fd6b-aa0d-4c47-8131-3d66fd65ad97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.635944 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-40b4fd6b-aa0d-4c47-8131-3d66fd65ad97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Jan 19 16:32:12.636497 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 584/1276] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:12.774604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:12.775210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:12.782027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.782740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.783736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:12.784183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:12.843576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:12.850803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-361b47c3-028c-4f71-bbd8-9d6a93eb6832 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079930 Jan 19 16:32:12.851361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 693/1277] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:12 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:13.274131 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:13.274729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:13.281382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.281839 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.282940 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.283384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.394846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-06045205-8d96-45e0-bda6-0dab69161af7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:13.395795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-06045205-8d96-45e0-bda6-0dab69161af7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:13.401559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06045205-8d96-45e0-bda6-0dab69161af7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.402019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06045205-8d96-45e0-bda6-0dab69161af7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.402803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06045205-8d96-45e0-bda6-0dab69161af7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.403239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06045205-8d96-45e0-bda6-0dab69161af7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.412967 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:13.421194 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:13.422685 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:13.423860 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0ab80dd3-5eda-41d4-9300-849a5e1ec314 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153453 Jan 19 16:32:13.424415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 585/1278] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:13.433062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-06045205-8d96-45e0-bda6-0dab69161af7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 Jan 19 16:32:13.433637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 694/1279] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:13.647564 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4ac1ed54-f48d-4f59-8378-58f3228a2eb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:13.648583 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4ac1ed54-f48d-4f59-8378-58f3228a2eb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:13.654979 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4ac1ed54-f48d-4f59-8378-58f3228a2eb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.655435 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4ac1ed54-f48d-4f59-8378-58f3228a2eb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.656252 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4ac1ed54-f48d-4f59-8378-58f3228a2eb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.656725 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4ac1ed54-f48d-4f59-8378-58f3228a2eb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.685633 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4ac1ed54-f48d-4f59-8378-58f3228a2eb1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041455 Jan 19 16:32:13.686197 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 586/1280] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:13.867757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:13.868365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:13.875061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.875508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.876304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:13.876739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:13.935688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:13.942940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ef163285-f32e-4c23-ad70-aa738a33e406 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078881 Jan 19 16:32:13.943503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 695/1281] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:13 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:14.441924 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:14.442530 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:14.444663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a794b8a9-ed5d-4a2c-ac23-c7eb44972ba0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:14.445651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a794b8a9-ed5d-4a2c-ac23-c7eb44972ba0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:14.448675 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.449128 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:14.449917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.450371 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:14.451578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a794b8a9-ed5d-4a2c-ac23-c7eb44972ba0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.452079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a794b8a9-ed5d-4a2c-ac23-c7eb44972ba0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:14.452863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a794b8a9-ed5d-4a2c-ac23-c7eb44972ba0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.453319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a794b8a9-ed5d-4a2c-ac23-c7eb44972ba0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:14.483117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a794b8a9-ed5d-4a2c-ac23-c7eb44972ba0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Jan 19 16:32:14.483698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 696/1282] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:14.582242 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:14.590563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:14.592525 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:14.593707 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2d753a51-f616-48eb-a570-9accf5d2c64a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155468 Jan 19 16:32:14.594266 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 587/1283] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:14 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:14.697076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fd7e27ca-76af-4ac8-90f0-991397f57c13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:14.697991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fd7e27ca-76af-4ac8-90f0-991397f57c13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:14.704464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7e27ca-76af-4ac8-90f0-991397f57c13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.704918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7e27ca-76af-4ac8-90f0-991397f57c13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:14.705693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7e27ca-76af-4ac8-90f0-991397f57c13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.706133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd7e27ca-76af-4ac8-90f0-991397f57c13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:14.736532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fd7e27ca-76af-4ac8-90f0-991397f57c13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Jan 19 16:32:14.737084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 697/1284] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:14.959277 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:14.959930 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:14.966907 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.967362 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:14.968189 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:14.968629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:15.026182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:15.034308 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-29c00398-0c0e-4151-9421-e2f44b8cfef2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078643 Jan 19 16:32:15.034866 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 588/1285] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:14 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:15.494353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6d2f0d0b-10d9-4341-8bf5-b10cdcc5c5fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:15.495357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6d2f0d0b-10d9-4341-8bf5-b10cdcc5c5fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:15.502308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d2f0d0b-10d9-4341-8bf5-b10cdcc5c5fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:15.502761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d2f0d0b-10d9-4341-8bf5-b10cdcc5c5fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:15.503540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d2f0d0b-10d9-4341-8bf5-b10cdcc5c5fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:15.504013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d2f0d0b-10d9-4341-8bf5-b10cdcc5c5fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:15.532058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6d2f0d0b-10d9-4341-8bf5-b10cdcc5c5fd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041360 Jan 19 16:32:15.532871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 698/1286] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:15.612271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:15.612881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:15.618809 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:15.619266 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:15.620081 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:15.620526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:15.748383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7767d116-b118-42fc-8a60-3ca2ba7e1564 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:15.749309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7767d116-b118-42fc-8a60-3ca2ba7e1564 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:15.749990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:15.755133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7767d116-b118-42fc-8a60-3ca2ba7e1564 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:15.755588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7767d116-b118-42fc-8a60-3ca2ba7e1564 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:15.756406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7767d116-b118-42fc-8a60-3ca2ba7e1564 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:15.756849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7767d116-b118-42fc-8a60-3ca2ba7e1564 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:15.758276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:15.759784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:15.760930 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-72af409f-b808-4acc-92d5-bdf2bf541186 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152431 Jan 19 16:32:15.761481 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 589/1287] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:15 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:15.786811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7767d116-b118-42fc-8a60-3ca2ba7e1564 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042744 Jan 19 16:32:15.787360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 699/1288] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:16.050670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:16.051208 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:16.057450 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.057908 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.058685 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.059124 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.120298 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:16.127605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ac033dfc-5fe8-4be8-8ca1-b51aa0208772 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080665 Jan 19 16:32:16.128195 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 590/1289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:16 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:16.543547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-96b9e9c1-67df-4ec3-ad33-eeab99f1b394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:16.544513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-96b9e9c1-67df-4ec3-ad33-eeab99f1b394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:16.550853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96b9e9c1-67df-4ec3-ad33-eeab99f1b394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.551308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96b9e9c1-67df-4ec3-ad33-eeab99f1b394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.552124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96b9e9c1-67df-4ec3-ad33-eeab99f1b394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.552570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96b9e9c1-67df-4ec3-ad33-eeab99f1b394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.581839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-96b9e9c1-67df-4ec3-ad33-eeab99f1b394 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041999 Jan 19 16:32:16.582394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 700/1290] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:16.779064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:16.779726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:16.786518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.786981 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.787784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.788228 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.798001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1e248596-84bf-48a3-ac05-5521ac00310b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:16.798913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1e248596-84bf-48a3-ac05-5521ac00310b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:16.804824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e248596-84bf-48a3-ac05-5521ac00310b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.805282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e248596-84bf-48a3-ac05-5521ac00310b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.806064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e248596-84bf-48a3-ac05-5521ac00310b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:16.806506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e248596-84bf-48a3-ac05-5521ac00310b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:16.836325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1e248596-84bf-48a3-ac05-5521ac00310b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 Jan 19 16:32:16.839725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 701/1291] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:16.915835 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:16.924534 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:16.926034 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:16.927158 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a2e8d71e-099a-49d4-9639-dd1ba7698df7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151814 Jan 19 16:32:16.927726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 591/1292] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:17.144067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:17.147620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:17.150813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.151274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:17.152124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.152529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:17.212621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:17.221022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2cc8f356-3d3b-4977-8d87-7b9962e302fd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080302 Jan 19 16:32:17.221961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 702/1293] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:17 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:17.594771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2374445e-c733-42c7-bc7f-9db815098958 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:17.596334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2374445e-c733-42c7-bc7f-9db815098958 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:17.602974 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2374445e-c733-42c7-bc7f-9db815098958 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.603434 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2374445e-c733-42c7-bc7f-9db815098958 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:17.604258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2374445e-c733-42c7-bc7f-9db815098958 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.604699 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2374445e-c733-42c7-bc7f-9db815098958 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:17.639106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2374445e-c733-42c7-bc7f-9db815098958 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049788 Jan 19 16:32:17.639666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 592/1294] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:17.848119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-30020051-0d1d-4cb2-b77a-d1c4b9ab6f1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:17.848956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-30020051-0d1d-4cb2-b77a-d1c4b9ab6f1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:17.855210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30020051-0d1d-4cb2-b77a-d1c4b9ab6f1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.855663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30020051-0d1d-4cb2-b77a-d1c4b9ab6f1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:17.856492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30020051-0d1d-4cb2-b77a-d1c4b9ab6f1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.856976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30020051-0d1d-4cb2-b77a-d1c4b9ab6f1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:17.884985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-30020051-0d1d-4cb2-b77a-d1c4b9ab6f1d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 Jan 19 16:32:17.885537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 703/1295] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:17.945842 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:17.946448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:17.952935 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.953381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:17.954151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:17.954586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:18.089378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:18.097471 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:18.099029 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:18.100134 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6c437bd2-1794-4c41-a520-200c03cdf225 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157964 Jan 19 16:32:18.100680 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 593/1296] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:17 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:18.238847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:18.239462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:18.245365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:18.245815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:18.246591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:18.247526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:18.306387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:18.314259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ba260f27-a155-40cd-acc0-e0bfd415f4cb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079021 Jan 19 16:32:18.314816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 704/1297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:18 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:18.650545 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a1c326c1-8403-4405-a2d7-fcbad0f4ced8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:18.651458 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a1c326c1-8403-4405-a2d7-fcbad0f4ced8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:18.658137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1c326c1-8403-4405-a2d7-fcbad0f4ced8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:18.658588 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1c326c1-8403-4405-a2d7-fcbad0f4ced8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:18.659366 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1c326c1-8403-4405-a2d7-fcbad0f4ced8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:18.659844 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a1c326c1-8403-4405-a2d7-fcbad0f4ced8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:18.689646 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a1c326c1-8403-4405-a2d7-fcbad0f4ced8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042884 Jan 19 16:32:18.690281 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 594/1298] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:18.897221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-22de920e-9bc0-412b-80a3-3090a0639ded tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:18.898143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-22de920e-9bc0-412b-80a3-3090a0639ded tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:18.905032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22de920e-9bc0-412b-80a3-3090a0639ded tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:18.905414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22de920e-9bc0-412b-80a3-3090a0639ded tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:18.906190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22de920e-9bc0-412b-80a3-3090a0639ded tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:18.906628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22de920e-9bc0-412b-80a3-3090a0639ded tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:18.935456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-22de920e-9bc0-412b-80a3-3090a0639ded tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042093 Jan 19 16:32:18.936038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 705/1299] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:19.118225 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:19.118820 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:19.124864 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.125317 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.126099 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.126539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.253431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:19.261522 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:19.263491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:19.264655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8eb95242-3fed-4d2d-bc81-5f9901200dff tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150128 Jan 19 16:32:19.265202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 595/1300] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:19.330728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:19.331334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:19.337146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.337595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.338363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.338799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.399466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:19.407631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6cd92fa5-6052-4d68-863c-daca3ddcb8db tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080226 Jan 19 16:32:19.408224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 706/1301] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:19 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:19.701701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3d96a74a-d7cd-420b-84a6-5214617c3e6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:19.702611 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3d96a74a-d7cd-420b-84a6-5214617c3e6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:19.708900 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3d96a74a-d7cd-420b-84a6-5214617c3e6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.709347 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3d96a74a-d7cd-420b-84a6-5214617c3e6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.710168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3d96a74a-d7cd-420b-84a6-5214617c3e6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.710605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3d96a74a-d7cd-420b-84a6-5214617c3e6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.738705 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3d96a74a-d7cd-420b-84a6-5214617c3e6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041452 Jan 19 16:32:19.739250 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 596/1302] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:19.946940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-04daaa29-5d96-4b8b-9687-84ca70c4a17c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:19.947836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-04daaa29-5d96-4b8b-9687-84ca70c4a17c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:19.954082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04daaa29-5d96-4b8b-9687-84ca70c4a17c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.954536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04daaa29-5d96-4b8b-9687-84ca70c4a17c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.955323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04daaa29-5d96-4b8b-9687-84ca70c4a17c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:19.955789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04daaa29-5d96-4b8b-9687-84ca70c4a17c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:19.984479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-04daaa29-5d96-4b8b-9687-84ca70c4a17c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041410 Jan 19 16:32:19.985124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 707/1303] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:20.283187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:20.283826 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:20.289969 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:20.290420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:20.291202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:20.291642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:20.424881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:20.425493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:20.426075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:20.431441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:20.431971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:20.434386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:20.434386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:20.434990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:20.436590 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:20.437714 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-938b22dd-1db9-41f1-a998-584d30d6076f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158443 Jan 19 16:32:20.438601 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 597/1304] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:20 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:20.492074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:20.499463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d4da44be-d537-4969-834b-84987d10c6cd tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078447 Jan 19 16:32:20.500067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 708/1305] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:20 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:20.749955 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f11ee4c1-15b3-4b2c-adaf-fff8556c846b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:20.750905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f11ee4c1-15b3-4b2c-adaf-fff8556c846b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:20.757216 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11ee4c1-15b3-4b2c-adaf-fff8556c846b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:20.757670 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11ee4c1-15b3-4b2c-adaf-fff8556c846b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:20.758445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11ee4c1-15b3-4b2c-adaf-fff8556c846b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:20.758889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f11ee4c1-15b3-4b2c-adaf-fff8556c846b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:20.788587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f11ee4c1-15b3-4b2c-adaf-fff8556c846b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jan 19 16:32:20.789132 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 598/1306] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:20.996240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d7b26aa5-d1de-426e-883c-9996eac61f07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:20.997892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d7b26aa5-d1de-426e-883c-9996eac61f07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:21.003757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7b26aa5-d1de-426e-883c-9996eac61f07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.004214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7b26aa5-d1de-426e-883c-9996eac61f07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.004996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7b26aa5-d1de-426e-883c-9996eac61f07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.005833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7b26aa5-d1de-426e-883c-9996eac61f07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.040999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d7b26aa5-d1de-426e-883c-9996eac61f07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048527 Jan 19 16:32:21.041564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 709/1307] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:21.456457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:21.457065 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:21.462971 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.463421 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.464227 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.464657 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.516585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:21.517190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:21.523200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.523643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.524441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.524870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.593669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:21.601250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9e6df43b-8d96-4c85-99d9-79971c16838c tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.089253 Jan 19 16:32:21.601805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 710/1308] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:21 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:21.616619 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:21.624744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:21.626223 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:21.627383 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-09bd9405-3f0d-4871-9346-192d48ff0313 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.174660 Jan 19 16:32:21.627977 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 599/1309] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:21 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:21.800069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-746d2208-0d50-4bcb-9bb7-04eea1c97d86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:21.800910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-746d2208-0d50-4bcb-9bb7-04eea1c97d86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:21.806758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-746d2208-0d50-4bcb-9bb7-04eea1c97d86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.807207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-746d2208-0d50-4bcb-9bb7-04eea1c97d86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.808046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-746d2208-0d50-4bcb-9bb7-04eea1c97d86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:21.808481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-746d2208-0d50-4bcb-9bb7-04eea1c97d86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:21.837360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-746d2208-0d50-4bcb-9bb7-04eea1c97d86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Jan 19 16:32:21.837911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 711/1310] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:22.053440 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-f50d9621-5edc-485f-ad0d-9d7e895431e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:22.054254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-f50d9621-5edc-485f-ad0d-9d7e895431e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:22.061129 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f50d9621-5edc-485f-ad0d-9d7e895431e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.061593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f50d9621-5edc-485f-ad0d-9d7e895431e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.062382 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f50d9621-5edc-485f-ad0d-9d7e895431e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.062819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-f50d9621-5edc-485f-ad0d-9d7e895431e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.092396 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-f50d9621-5edc-485f-ad0d-9d7e895431e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Jan 19 16:32:22.092953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 600/1311] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:22.617666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:22.618343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:22.624411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.624864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.625639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.626077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.645741 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:22.646437 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:22.652526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.652974 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.654327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.654763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.691735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:22.699210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dd87ce04-91fc-407f-bfe0-528e4b81cad7 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085222 Jan 19 16:32:22.699800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 712/1312] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:22 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:22.785403 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:22.793490 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:22.795538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:22.796704 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9a9e520f-8f03-42a2-afaa-b0ca8e3269cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154619 Jan 19 16:32:22.797251 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 601/1313] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:22 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:22.848545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-273b49e6-10f7-49a2-8e3f-46768de10890 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:22.849459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-273b49e6-10f7-49a2-8e3f-46768de10890 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:22.855347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-273b49e6-10f7-49a2-8e3f-46768de10890 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.855890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-273b49e6-10f7-49a2-8e3f-46768de10890 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.857333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-273b49e6-10f7-49a2-8e3f-46768de10890 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:22.857776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-273b49e6-10f7-49a2-8e3f-46768de10890 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:22.888544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-273b49e6-10f7-49a2-8e3f-46768de10890 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 Jan 19 16:32:22.889147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 713/1314] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:23.103577 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a26230f7-d5d7-474c-9e61-c378cf54ff53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:23.104666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a26230f7-d5d7-474c-9e61-c378cf54ff53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:23.110889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a26230f7-d5d7-474c-9e61-c378cf54ff53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.111340 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a26230f7-d5d7-474c-9e61-c378cf54ff53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.112159 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a26230f7-d5d7-474c-9e61-c378cf54ff53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.112596 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a26230f7-d5d7-474c-9e61-c378cf54ff53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.141804 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a26230f7-d5d7-474c-9e61-c378cf54ff53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041853 Jan 19 16:32:23.142280 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 602/1315] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:23.715947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:23.716567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:23.722851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.723300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.724121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.724659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.785613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:23.792938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-43fcb6e4-6ae7-4330-a0fa-f5ad372303d4 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081061 Jan 19 16:32:23.793503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 714/1316] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:23 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:23.814975 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:23.815587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:23.821620 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.822073 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.822850 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.823289 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.901460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fcdbe3bb-9072-4e15-8dd1-b2ef86aac4d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:23.902311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fcdbe3bb-9072-4e15-8dd1-b2ef86aac4d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:23.908479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcdbe3bb-9072-4e15-8dd1-b2ef86aac4d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.908924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcdbe3bb-9072-4e15-8dd1-b2ef86aac4d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.909700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcdbe3bb-9072-4e15-8dd1-b2ef86aac4d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:23.910134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcdbe3bb-9072-4e15-8dd1-b2ef86aac4d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:23.940318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fcdbe3bb-9072-4e15-8dd1-b2ef86aac4d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Jan 19 16:32:23.940862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 715/1317] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:23.953556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:23.961887 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:23.963369 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:23.964558 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1251078a-d53b-49bb-8c45-9eb39f8bd0c7 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153212 Jan 19 16:32:23.965114 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 603/1318] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:23 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:24.153028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e8f19133-bbc1-47c9-8a53-dbc4048c297e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:24.154427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e8f19133-bbc1-47c9-8a53-dbc4048c297e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:24.160543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8f19133-bbc1-47c9-8a53-dbc4048c297e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.160986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8f19133-bbc1-47c9-8a53-dbc4048c297e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:24.161753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8f19133-bbc1-47c9-8a53-dbc4048c297e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.162185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8f19133-bbc1-47c9-8a53-dbc4048c297e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:24.190287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e8f19133-bbc1-47c9-8a53-dbc4048c297e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Jan 19 16:32:24.190898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 716/1319] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:24.810991 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:24.811600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:24.817907 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.818359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:24.819137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.819574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:24.877154 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:24.884320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8d617b89-9bb0-4a66-a870-b0f6c08b6edb tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077597 Jan 19 16:32:24.884877 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 604/1320] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:24 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:24.952097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d2f66ac5-8b85-4004-b574-6a121ce16708 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:24.953008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d2f66ac5-8b85-4004-b574-6a121ce16708 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:24.959276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2f66ac5-8b85-4004-b574-6a121ce16708 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.959752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2f66ac5-8b85-4004-b574-6a121ce16708 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:24.960528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2f66ac5-8b85-4004-b574-6a121ce16708 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.960968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2f66ac5-8b85-4004-b574-6a121ce16708 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:24.983046 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:24.983637 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:24.989189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d2f66ac5-8b85-4004-b574-6a121ce16708 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Jan 19 16:32:24.989411 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.989748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 717/1321] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:24.989941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:24.990723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:24.991152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:25.117470 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:25.126068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:25.127620 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:25.128758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-730ea932-2f70-43ef-806c-2112d50595f0 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.149363 Jan 19 16:32:25.129315 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 605/1322] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:24 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:25.201586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3183732e-53c2-40d7-9c0d-ce3eddbda1ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:25.202492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3183732e-53c2-40d7-9c0d-ce3eddbda1ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:25.208344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3183732e-53c2-40d7-9c0d-ce3eddbda1ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:25.208800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3183732e-53c2-40d7-9c0d-ce3eddbda1ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:25.209570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3183732e-53c2-40d7-9c0d-ce3eddbda1ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:25.210014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3183732e-53c2-40d7-9c0d-ce3eddbda1ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:25.238979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3183732e-53c2-40d7-9c0d-ce3eddbda1ad tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Jan 19 16:32:25.239539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 718/1323] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:25.900869 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:25.901482 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:25.908809 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:25.909260 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:25.910050 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:25.910491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:25.972823 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:25.980240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e9828aa4-c72a-45a4-86e7-63ff4c81caf5 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083070 Jan 19 16:32:25.980808 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 606/1324] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:25 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:26.002244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-54e87497-745c-4320-a255-026b5cce8372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:26.003160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-54e87497-745c-4320-a255-026b5cce8372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:26.009398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e87497-745c-4320-a255-026b5cce8372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:26.009846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e87497-745c-4320-a255-026b5cce8372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:26.010623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e87497-745c-4320-a255-026b5cce8372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:26.011061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e87497-745c-4320-a255-026b5cce8372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:26.041667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-54e87497-745c-4320-a255-026b5cce8372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Jan 19 16:32:26.042227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 719/1325] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:26.147419 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:26.148038 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:26.154543 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:26.155075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:26.155809 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:26.156239 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:26.252657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32d9c338-cf07-4d14-976e-1e9cc4771829 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:26.253767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32d9c338-cf07-4d14-976e-1e9cc4771829 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:26.261646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32d9c338-cf07-4d14-976e-1e9cc4771829 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:26.262107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32d9c338-cf07-4d14-976e-1e9cc4771829 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:26.263422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32d9c338-cf07-4d14-976e-1e9cc4771829 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:26.263910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32d9c338-cf07-4d14-976e-1e9cc4771829 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:26.292432 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:26.295903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32d9c338-cf07-4d14-976e-1e9cc4771829 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048345 Jan 19 16:32:26.299201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 720/1326] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:26.300945 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:26.302466 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:26.303608 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-401517a3-e566-426b-9c18-1dda42f55db9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159905 Jan 19 16:32:26.304174 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 607/1327] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:26 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:26.997719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:26.998329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:27.004186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.004731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.005385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.005818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.053139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4a75cd10-86b4-49a9-a356-6df63420de3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:27.054048 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4a75cd10-86b4-49a9-a356-6df63420de3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:27.060534 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a75cd10-86b4-49a9-a356-6df63420de3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.060980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a75cd10-86b4-49a9-a356-6df63420de3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.061771 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a75cd10-86b4-49a9-a356-6df63420de3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.062199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a75cd10-86b4-49a9-a356-6df63420de3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.065588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:27.074452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8bbe9642-3cdc-4127-bef0-5a1223b18b8f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081037 Jan 19 16:32:27.075983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 721/1328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:26 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:27.093111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4a75cd10-86b4-49a9-a356-6df63420de3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Jan 19 16:32:27.093669 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 608/1329] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:27.307148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2bb8dcdc-2294-4f88-9ec8-e1056e56f0c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:27.308074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2bb8dcdc-2294-4f88-9ec8-e1056e56f0c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:27.313815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2bb8dcdc-2294-4f88-9ec8-e1056e56f0c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.314258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2bb8dcdc-2294-4f88-9ec8-e1056e56f0c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.315026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2bb8dcdc-2294-4f88-9ec8-e1056e56f0c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.315457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2bb8dcdc-2294-4f88-9ec8-e1056e56f0c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.321972 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:27.322667 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:27.328477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.328934 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.329712 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:27.330145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:27.344692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2bb8dcdc-2294-4f88-9ec8-e1056e56f0c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041234 Jan 19 16:32:27.345259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 722/1330] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:27.474203 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:27.482652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:27.484182 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:27.485326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-762a4a3b-6ed6-486d-ab5f-468fae0ba3d3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.167134 Jan 19 16:32:27.485880 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 609/1331] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:27 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:28.091460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:28.092122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:28.098466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.099070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.099976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.100423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.104638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-726bac14-9606-48cc-811a-21d571fe7c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:28.105554 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-726bac14-9606-48cc-811a-21d571fe7c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:28.112368 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-726bac14-9606-48cc-811a-21d571fe7c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.112819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-726bac14-9606-48cc-811a-21d571fe7c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.113631 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-726bac14-9606-48cc-811a-21d571fe7c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.114071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-726bac14-9606-48cc-811a-21d571fe7c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.145190 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-726bac14-9606-48cc-811a-21d571fe7c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Jan 19 16:32:28.145779 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 610/1332] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:28.163184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:28.171294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0215b2b9-8e6f-4b38-90ff-975aed3dc78a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083478 Jan 19 16:32:28.171884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 723/1333] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:28 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:28.355865 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-fe5fcfb5-51fe-48f6-bbd5-887ac35234bb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:28.357265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-fe5fcfb5-51fe-48f6-bbd5-887ac35234bb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:28.363005 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe5fcfb5-51fe-48f6-bbd5-887ac35234bb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.363446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe5fcfb5-51fe-48f6-bbd5-887ac35234bb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.364980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe5fcfb5-51fe-48f6-bbd5-887ac35234bb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.365540 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-fe5fcfb5-51fe-48f6-bbd5-887ac35234bb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.394540 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-fe5fcfb5-51fe-48f6-bbd5-887ac35234bb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Jan 19 16:32:28.395089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 611/1334] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:28.503515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:28.504161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:28.510045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.510496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.511275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:28.511735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:28.640349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:28.648727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:28.650211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:28.651355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-21267a8f-fafb-4b57-a5ba-ade2d88febb9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151644 Jan 19 16:32:28.651941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 724/1335] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:28 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:29.157401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7feca536-62b3-4d2a-be41-547fdbeb575c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:29.158327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7feca536-62b3-4d2a-be41-547fdbeb575c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:29.164206 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7feca536-62b3-4d2a-be41-547fdbeb575c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.164656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7feca536-62b3-4d2a-be41-547fdbeb575c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.165416 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7feca536-62b3-4d2a-be41-547fdbeb575c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.165844 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7feca536-62b3-4d2a-be41-547fdbeb575c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.188034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:29.188787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:29.194556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7feca536-62b3-4d2a-be41-547fdbeb575c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Jan 19 16:32:29.195033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.195146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 612/1336] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:29.195491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.196312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.196753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.255734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:29.263413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ab1caf4-7a2e-44c4-b16c-3a1ba6a9bf1e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079778 Jan 19 16:32:29.264006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 725/1337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:29 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:29.406178 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-aba784cc-8739-4bc0-bbc6-02fe9e8a283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:29.407370 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-aba784cc-8739-4bc0-bbc6-02fe9e8a283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:29.413323 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aba784cc-8739-4bc0-bbc6-02fe9e8a283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.413704 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aba784cc-8739-4bc0-bbc6-02fe9e8a283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.414467 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aba784cc-8739-4bc0-bbc6-02fe9e8a283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.414892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aba784cc-8739-4bc0-bbc6-02fe9e8a283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.443763 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-aba784cc-8739-4bc0-bbc6-02fe9e8a283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041267 Jan 19 16:32:29.444315 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 613/1338] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:29.670459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:29.670991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:29.676956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.677456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.678241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:29.678679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:29.810005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:29.818756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:29.820278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:29.821469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2612cede-f525-41d0-841a-b70879422269 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155329 Jan 19 16:32:29.822028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 726/1339] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:29 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:30.206364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-32db9bd9-2661-429a-87a0-5826a73f21d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:30.207258 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-32db9bd9-2661-429a-87a0-5826a73f21d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:30.213528 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32db9bd9-2661-429a-87a0-5826a73f21d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.213987 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32db9bd9-2661-429a-87a0-5826a73f21d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:30.214738 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32db9bd9-2661-429a-87a0-5826a73f21d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.215169 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32db9bd9-2661-429a-87a0-5826a73f21d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:30.244647 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-32db9bd9-2661-429a-87a0-5826a73f21d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Jan 19 16:32:30.245185 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 614/1340] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:30.278705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:30.279860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:30.286293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.286745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:30.287512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.287983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:30.345603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:30.352857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9792dc8e-57d8-4fc4-bc04-76749a2fa918 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077715 Jan 19 16:32:30.353412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 727/1341] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:30 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:30.454785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ace28209-11fa-4e16-a789-ff933295233f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:30.455704 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ace28209-11fa-4e16-a789-ff933295233f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:30.461652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ace28209-11fa-4e16-a789-ff933295233f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.462035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ace28209-11fa-4e16-a789-ff933295233f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:30.462807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ace28209-11fa-4e16-a789-ff933295233f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.463374 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ace28209-11fa-4e16-a789-ff933295233f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:30.494220 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ace28209-11fa-4e16-a789-ff933295233f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Jan 19 16:32:30.494779 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 615/1342] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:30.839878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:30.840489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:30.846274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.846724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:30.847533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:30.847999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:31.044072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:31.052976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:31.054471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:31.055613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e3ebd209-9f11-4748-ae8a-3462a11456f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.219538 Jan 19 16:32:31.056218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 728/1343] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:30 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:31.255444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3c95f884-3dd5-4252-a7af-1629e22ee00b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:31.256387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3c95f884-3dd5-4252-a7af-1629e22ee00b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:31.262689 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c95f884-3dd5-4252-a7af-1629e22ee00b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:31.263143 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c95f884-3dd5-4252-a7af-1629e22ee00b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:31.263966 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c95f884-3dd5-4252-a7af-1629e22ee00b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:31.264410 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3c95f884-3dd5-4252-a7af-1629e22ee00b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:31.293717 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3c95f884-3dd5-4252-a7af-1629e22ee00b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Jan 19 16:32:31.294278 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 616/1344] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:31.368848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:31.369485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:31.376269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:31.376710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:31.377472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:31.377900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:31.438287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:31.445740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c4020bbf-e75a-406e-8db3-5c2872b68867 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080512 Jan 19 16:32:31.446290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 729/1345] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:31 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:31.505762 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5aff3a34-cae0-4cd1-880f-927cd6ad9127 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:31.506678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5aff3a34-cae0-4cd1-880f-927cd6ad9127 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:31.512921 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5aff3a34-cae0-4cd1-880f-927cd6ad9127 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:31.513380 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5aff3a34-cae0-4cd1-880f-927cd6ad9127 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:31.514179 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5aff3a34-cae0-4cd1-880f-927cd6ad9127 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:31.514600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5aff3a34-cae0-4cd1-880f-927cd6ad9127 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:31.543452 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5aff3a34-cae0-4cd1-880f-927cd6ad9127 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Jan 19 16:32:31.544040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 617/1346] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:32.074753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:32.075469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:32.081425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.081884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.082701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.083205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.219055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:32.227531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:32.229074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:32.230318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b35f9885-69b5-44c0-8874-2549cfe7e897 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.160398 Jan 19 16:32:32.230878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 730/1347] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:32 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:32.305565 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ffe3e29e-fa62-4b92-8221-84c673941555 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:32.306544 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ffe3e29e-fa62-4b92-8221-84c673941555 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:32.312879 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffe3e29e-fa62-4b92-8221-84c673941555 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.313334 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffe3e29e-fa62-4b92-8221-84c673941555 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.314118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffe3e29e-fa62-4b92-8221-84c673941555 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.314560 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffe3e29e-fa62-4b92-8221-84c673941555 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.343729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ffe3e29e-fa62-4b92-8221-84c673941555 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041887 Jan 19 16:32:32.344302 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 618/1348] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:32.461786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:32.462413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:32.469141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.469591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.470376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.470791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.528149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:32.536302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-74f3f54e-a639-4457-94b2-709d7ad57d00 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078139 Jan 19 16:32:32.536875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 731/1349] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:32 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:32.555234 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-01d83e74-9b0f-4872-bb3d-d1b5cab5e548 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:32.556166 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-01d83e74-9b0f-4872-bb3d-d1b5cab5e548 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:32.561937 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-01d83e74-9b0f-4872-bb3d-d1b5cab5e548 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.562384 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-01d83e74-9b0f-4872-bb3d-d1b5cab5e548 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.563144 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-01d83e74-9b0f-4872-bb3d-d1b5cab5e548 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:32.563573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-01d83e74-9b0f-4872-bb3d-d1b5cab5e548 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:32.591061 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-01d83e74-9b0f-4872-bb3d-d1b5cab5e548 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039503 Jan 19 16:32:32.592438 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 619/1350] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:33.249459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:33.250067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:33.255970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.256416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.258238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.258678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.354415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cd49403a-7a18-422f-84af-b63ad2d88075 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:33.355438 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cd49403a-7a18-422f-84af-b63ad2d88075 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:33.361796 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cd49403a-7a18-422f-84af-b63ad2d88075 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.362249 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cd49403a-7a18-422f-84af-b63ad2d88075 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.363025 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cd49403a-7a18-422f-84af-b63ad2d88075 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.363647 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cd49403a-7a18-422f-84af-b63ad2d88075 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.391093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:33.398743 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cd49403a-7a18-422f-84af-b63ad2d88075 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Jan 19 16:32:33.399269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:33.399447 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 620/1351] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:33.400968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:33.402115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3fb89a72-8a6a-4ad2-a1fa-b6f0e0037c42 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156843 Jan 19 16:32:33.402656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 732/1352] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:33 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:33.552864 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:33.553393 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:33.559265 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.559750 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.560622 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.561565 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.602436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc0a2ea3-9769-4ffa-9a39-730e19c58ab4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:33.603346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc0a2ea3-9769-4ffa-9a39-730e19c58ab4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:33.610649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc0a2ea3-9769-4ffa-9a39-730e19c58ab4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.611034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc0a2ea3-9769-4ffa-9a39-730e19c58ab4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.611816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc0a2ea3-9769-4ffa-9a39-730e19c58ab4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:33.612259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc0a2ea3-9769-4ffa-9a39-730e19c58ab4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:33.622367 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:33.630617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-11b93a13-3eea-4f4d-9350-b784ddc3a589 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081458 Jan 19 16:32:33.631184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 621/1353] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:33 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:33.642235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc0a2ea3-9769-4ffa-9a39-730e19c58ab4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Jan 19 16:32:33.642782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 733/1354] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:34.410772 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-6d43ca92-8cea-4d8e-8150-f54d1e26abc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:34.411729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-6d43ca92-8cea-4d8e-8150-f54d1e26abc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:34.417789 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d43ca92-8cea-4d8e-8150-f54d1e26abc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.418243 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d43ca92-8cea-4d8e-8150-f54d1e26abc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.419082 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d43ca92-8cea-4d8e-8150-f54d1e26abc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.419526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-6d43ca92-8cea-4d8e-8150-f54d1e26abc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.419844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:34.420703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:34.426531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.426977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.427776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.428204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.450293 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-6d43ca92-8cea-4d8e-8150-f54d1e26abc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Jan 19 16:32:34.450869 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 622/1355] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:34.556491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:34.565246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:34.566774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:34.567960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-94c82162-623a-423b-b635-ecb0c23daba4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151952 Jan 19 16:32:34.568518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 734/1356] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:34 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:34.646099 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:34.646628 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:34.652793 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.653246 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.653641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6aca6948-7e2f-4a54-904d-166d7fdce668 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:34.654115 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.654461 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.654582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6aca6948-7e2f-4a54-904d-166d7fdce668 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:34.661148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aca6948-7e2f-4a54-904d-166d7fdce668 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.661604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aca6948-7e2f-4a54-904d-166d7fdce668 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.662398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aca6948-7e2f-4a54-904d-166d7fdce668 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:34.662836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aca6948-7e2f-4a54-904d-166d7fdce668 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:34.694293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6aca6948-7e2f-4a54-904d-166d7fdce668 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Jan 19 16:32:34.696322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 735/1357] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:34.714617 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:34.721980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d336242a-869d-461f-adcb-ad421c8b4f52 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079594 Jan 19 16:32:34.722535 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 623/1358] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:34 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:35.462420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc7588fa-14cc-40bc-9026-90e08f66a9ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:35.463399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc7588fa-14cc-40bc-9026-90e08f66a9ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:35.470038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc7588fa-14cc-40bc-9026-90e08f66a9ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.470495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc7588fa-14cc-40bc-9026-90e08f66a9ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.471287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc7588fa-14cc-40bc-9026-90e08f66a9ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.471768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc7588fa-14cc-40bc-9026-90e08f66a9ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.501670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc7588fa-14cc-40bc-9026-90e08f66a9ae tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 Jan 19 16:32:35.502253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 736/1359] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:35.586662 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:35.587405 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:35.595551 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.596095 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.596894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.597333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.708218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d5ed25e-8b96-4988-b037-6198918d799c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:35.709143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d5ed25e-8b96-4988-b037-6198918d799c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:35.715402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5ed25e-8b96-4988-b037-6198918d799c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.715828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5ed25e-8b96-4988-b037-6198918d799c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.716678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5ed25e-8b96-4988-b037-6198918d799c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.717641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5ed25e-8b96-4988-b037-6198918d799c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.735019 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:35.743165 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:35.744687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:35.745837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2bb37087-4349-495d-a895-17a4af228216 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162921 Jan 19 16:32:35.746386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 624/1360] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:35 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:35.748227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d5ed25e-8b96-4988-b037-6198918d799c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Jan 19 16:32:35.751947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 737/1361] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:35.752106 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:35.752233 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:35.757979 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.758424 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.759198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:35.759629 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:35.820339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:35.828339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-98741e37-5338-47b8-99f4-adb55ee9b155 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081025 Jan 19 16:32:35.828916 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 625/1362] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:35 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:36.512172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ec9dc915-0ca5-4713-b40c-6ef74b7310ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:36.513087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ec9dc915-0ca5-4713-b40c-6ef74b7310ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:36.519046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec9dc915-0ca5-4713-b40c-6ef74b7310ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.519501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec9dc915-0ca5-4713-b40c-6ef74b7310ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.520368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec9dc915-0ca5-4713-b40c-6ef74b7310ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.520823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec9dc915-0ca5-4713-b40c-6ef74b7310ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.550750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ec9dc915-0ca5-4713-b40c-6ef74b7310ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Jan 19 16:32:36.551320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 738/1363] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:36.765728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0575bacb-11f2-4799-ae9d-17a1f6eceed1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:36.767175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:36.767567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0575bacb-11f2-4799-ae9d-17a1f6eceed1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:36.768255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:36.777989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0575bacb-11f2-4799-ae9d-17a1f6eceed1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.778185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.778727 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0575bacb-11f2-4799-ae9d-17a1f6eceed1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.778846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.780553 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0575bacb-11f2-4799-ae9d-17a1f6eceed1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.780665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.781277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.781388 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0575bacb-11f2-4799-ae9d-17a1f6eceed1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.830522 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0575bacb-11f2-4799-ae9d-17a1f6eceed1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071925 Jan 19 16:32:36.831204 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 626/1364] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:36.847730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:36.847730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:36.851700 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.852156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.852946 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:36.853381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:36.921447 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:36.928620 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8ac40558-6f73-4b14-98be-e5c195abbe0b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087818 Jan 19 16:32:36.929180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 627/1365] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:36 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:36.949760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:36.961387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:36.962913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:36.964087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-84626c95-04a9-4bf0-91db-71f4d2b0426b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.203373 Jan 19 16:32:36.964648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 739/1366] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:36 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:37.562732 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-623ee064-6e67-4130-a4a1-3b61fbea0f97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:37.563650 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-623ee064-6e67-4130-a4a1-3b61fbea0f97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:37.569586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-623ee064-6e67-4130-a4a1-3b61fbea0f97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.570038 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-623ee064-6e67-4130-a4a1-3b61fbea0f97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:37.570816 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-623ee064-6e67-4130-a4a1-3b61fbea0f97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.571257 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-623ee064-6e67-4130-a4a1-3b61fbea0f97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:37.600133 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-623ee064-6e67-4130-a4a1-3b61fbea0f97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 Jan 19 16:32:37.600687 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 628/1367] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:37.842918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-243a8fc9-9c92-41f4-ae61-f2080d091b5f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:37.843758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-243a8fc9-9c92-41f4-ae61-f2080d091b5f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:37.849932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-243a8fc9-9c92-41f4-ae61-f2080d091b5f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.850375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-243a8fc9-9c92-41f4-ae61-f2080d091b5f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:37.851140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-243a8fc9-9c92-41f4-ae61-f2080d091b5f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.851570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-243a8fc9-9c92-41f4-ae61-f2080d091b5f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:37.879916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-243a8fc9-9c92-41f4-ae61-f2080d091b5f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Jan 19 16:32:37.880468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 740/1368] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:37.944982 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:37.945581 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:37.952444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.952884 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:37.953647 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.954076 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:37.982044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:37.982944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:37.988896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.989355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:37.990139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:37.990579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:38.019235 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:38.027072 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-0a3dde10-0f16-4bb6-85f8-0898e62c9494 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085765 Jan 19 16:32:38.027638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 629/1369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:37 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:38.120989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:38.129820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:38.131320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:38.132524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bd602eb7-9a78-45cd-a34a-eaf35c7ca7f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154155 Jan 19 16:32:38.133091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 741/1370] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:37 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:38.612179 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a029aba5-d497-4093-b5d2-ec9aa06c90a8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:38.613248 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a029aba5-d497-4093-b5d2-ec9aa06c90a8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:38.619137 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a029aba5-d497-4093-b5d2-ec9aa06c90a8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:38.619592 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a029aba5-d497-4093-b5d2-ec9aa06c90a8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:38.620401 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a029aba5-d497-4093-b5d2-ec9aa06c90a8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:38.620841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a029aba5-d497-4093-b5d2-ec9aa06c90a8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:38.649751 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a029aba5-d497-4093-b5d2-ec9aa06c90a8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Jan 19 16:32:38.650314 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 630/1371] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:38.891997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-72a85163-9c14-497d-b1e0-ae4d6e0a1d0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:38.892842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-72a85163-9c14-497d-b1e0-ae4d6e0a1d0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:38.899277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72a85163-9c14-497d-b1e0-ae4d6e0a1d0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:38.899764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72a85163-9c14-497d-b1e0-ae4d6e0a1d0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:38.900563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72a85163-9c14-497d-b1e0-ae4d6e0a1d0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:38.901005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72a85163-9c14-497d-b1e0-ae4d6e0a1d0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:38.931418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-72a85163-9c14-497d-b1e0-ae4d6e0a1d0e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Jan 19 16:32:38.932005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 742/1372] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:39.044167 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:39.044851 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:39.051088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.051538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.052348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.052785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.112247 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:39.119457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9a9097c5-3166-485c-b166-b813063a68f0 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078909 Jan 19 16:32:39.120050 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 631/1373] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:39 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:39.150675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:39.151472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:39.157765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.158165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.158934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.159362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.288297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:39.296348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:39.297821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:39.298951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e05f6c54-22a6-4de9-b36d-cd48922b5d08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152320 Jan 19 16:32:39.299490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 743/1374] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:39 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:39.661602 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-14ec6b26-3d07-4218-ad28-d5ae162def0a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:39.662505 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-14ec6b26-3d07-4218-ad28-d5ae162def0a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:39.668441 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-14ec6b26-3d07-4218-ad28-d5ae162def0a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.668892 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-14ec6b26-3d07-4218-ad28-d5ae162def0a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.670216 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-14ec6b26-3d07-4218-ad28-d5ae162def0a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.670655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-14ec6b26-3d07-4218-ad28-d5ae162def0a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.700162 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-14ec6b26-3d07-4218-ad28-d5ae162def0a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Jan 19 16:32:39.700728 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 632/1375] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:39.942406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fdf00236-f065-4fe8-ae6f-b10c78c90071 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:39.943261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fdf00236-f065-4fe8-ae6f-b10c78c90071 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:39.949514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdf00236-f065-4fe8-ae6f-b10c78c90071 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.949958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdf00236-f065-4fe8-ae6f-b10c78c90071 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.950726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdf00236-f065-4fe8-ae6f-b10c78c90071 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:39.951162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdf00236-f065-4fe8-ae6f-b10c78c90071 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:39.979413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fdf00236-f065-4fe8-ae6f-b10c78c90071 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Jan 19 16:32:39.979992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 744/1376] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:40.136193 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:40.136801 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:40.143615 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:40.144100 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:40.144881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:40.145320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:40.203102 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:40.210493 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5a604380-c702-44cd-9165-92ebffdc0401 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078005 Jan 19 16:32:40.211057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 633/1377] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:40 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:40.318010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:40.318621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:40.324588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:40.325036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:40.326314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:40.326798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:40.452446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:40.460487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:40.461975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:40.463114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9e36b13d-4448-4874-8fd7-8dfbec7b64e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.148769 Jan 19 16:32:40.463665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 745/1378] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:40 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:40.711592 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-86a75165-c232-45b4-b5eb-9d30966f6961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:40.712625 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-86a75165-c232-45b4-b5eb-9d30966f6961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:40.719017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86a75165-c232-45b4-b5eb-9d30966f6961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:40.719468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86a75165-c232-45b4-b5eb-9d30966f6961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:40.720280 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86a75165-c232-45b4-b5eb-9d30966f6961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:40.720724 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-86a75165-c232-45b4-b5eb-9d30966f6961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:40.749339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-86a75165-c232-45b4-b5eb-9d30966f6961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041555 Jan 19 16:32:40.749905 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 634/1379] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:40.991577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5ea8c8f4-4aad-4874-a544-ccf368c037c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:40.992419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5ea8c8f4-4aad-4874-a544-ccf368c037c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:40.998658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ea8c8f4-4aad-4874-a544-ccf368c037c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:40.999105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ea8c8f4-4aad-4874-a544-ccf368c037c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:40.999913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ea8c8f4-4aad-4874-a544-ccf368c037c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:41.000350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ea8c8f4-4aad-4874-a544-ccf368c037c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:41.030201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5ea8c8f4-4aad-4874-a544-ccf368c037c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042381 Jan 19 16:32:41.030760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 746/1380] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:41.227482 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:41.228120 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:41.234563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:41.235050 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:41.235880 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:41.236327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:41.294939 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:41.302271 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-aeb4a71b-4777-4267-9b19-1473bdf36100 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078546 Jan 19 16:32:41.302837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 635/1381] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:41 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:41.481841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:41.482579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:41.488443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:41.488885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:41.489648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:41.490078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:41.618753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:41.627273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:41.628793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:41.629920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b99de135-dd83-4d59-a17e-cef41b6a94dc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151758 Jan 19 16:32:41.630488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 747/1382] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:41 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:41.760784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-793fe43f-999a-4a03-9b20-6d2310d5bbb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:41.761735 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-793fe43f-999a-4a03-9b20-6d2310d5bbb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:41.767693 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793fe43f-999a-4a03-9b20-6d2310d5bbb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:41.768213 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793fe43f-999a-4a03-9b20-6d2310d5bbb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:41.768980 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793fe43f-999a-4a03-9b20-6d2310d5bbb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:41.769454 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-793fe43f-999a-4a03-9b20-6d2310d5bbb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:41.798327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-793fe43f-999a-4a03-9b20-6d2310d5bbb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041373 Jan 19 16:32:41.798880 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 636/1383] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:42.042195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a995e885-a738-4f20-9095-27d4fae19d08 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:42.043142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a995e885-a738-4f20-9095-27d4fae19d08 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:42.050064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a995e885-a738-4f20-9095-27d4fae19d08 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.050523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a995e885-a738-4f20-9095-27d4fae19d08 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.051294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a995e885-a738-4f20-9095-27d4fae19d08 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.051759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a995e885-a738-4f20-9095-27d4fae19d08 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.079830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a995e885-a738-4f20-9095-27d4fae19d08 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041504 Jan 19 16:32:42.080379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 748/1384] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:42.319358 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:42.319927 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:42.326240 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.326697 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.327473 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.327944 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.387118 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:42.395122 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-5b14f4c5-b6c8-4eca-9784-179dfca9e83e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079493 Jan 19 16:32:42.395680 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 637/1385] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:42 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:42.648634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:42.649152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:42.655622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.656093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.657118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.657550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.789903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:42.798715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:42.800265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:42.801411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-26206b4d-d314-4a77-8ba2-659ebc3ee279 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156530 Jan 19 16:32:42.801967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 749/1386] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:42 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:42.809497 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e33852af-7497-4499-a57d-f1cfdacebb3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:42.810477 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e33852af-7497-4499-a57d-f1cfdacebb3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:42.816318 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e33852af-7497-4499-a57d-f1cfdacebb3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.816770 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e33852af-7497-4499-a57d-f1cfdacebb3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.817542 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e33852af-7497-4499-a57d-f1cfdacebb3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:42.817981 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e33852af-7497-4499-a57d-f1cfdacebb3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:42.846253 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e33852af-7497-4499-a57d-f1cfdacebb3c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040492 Jan 19 16:32:42.846807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 638/1387] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:43.090510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3e59a339-23ec-4dec-840f-af39214e055f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:43.091972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3e59a339-23ec-4dec-840f-af39214e055f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:43.098687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e59a339-23ec-4dec-840f-af39214e055f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.099275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e59a339-23ec-4dec-840f-af39214e055f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.100416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e59a339-23ec-4dec-840f-af39214e055f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.101014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e59a339-23ec-4dec-840f-af39214e055f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.130757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3e59a339-23ec-4dec-840f-af39214e055f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Jan 19 16:32:43.131315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 750/1388] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:43.413043 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:43.413603 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:43.419914 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.420387 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.421157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.421594 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.483309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:43.490666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-13f2b776-c4a5-4c77-ae4f-3073056fdb8e tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081413 Jan 19 16:32:43.491225 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 639/1389] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:43 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:43.819811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:43.820429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:43.826313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.826768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.827545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.828015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.856520 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c128aba1-4db2-401b-8efa-78f155d4616c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:43.858146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c128aba1-4db2-401b-8efa-78f155d4616c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:43.864356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c128aba1-4db2-401b-8efa-78f155d4616c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.864894 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c128aba1-4db2-401b-8efa-78f155d4616c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.865755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c128aba1-4db2-401b-8efa-78f155d4616c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:43.866201 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c128aba1-4db2-401b-8efa-78f155d4616c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:43.897064 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c128aba1-4db2-401b-8efa-78f155d4616c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Jan 19 16:32:43.897638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 640/1390] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:43.955188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:43.963536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:43.965086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:43.966255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a44ff5cb-845f-4b9d-93d7-c1cc23e7f5cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150253 Jan 19 16:32:43.967391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 751/1391] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:43 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:44.143044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-64238270-7bad-4525-8662-ca719e7995fd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:44.144310 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-64238270-7bad-4525-8662-ca719e7995fd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:44.150198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64238270-7bad-4525-8662-ca719e7995fd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.150655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64238270-7bad-4525-8662-ca719e7995fd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:44.151433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64238270-7bad-4525-8662-ca719e7995fd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.151909 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-64238270-7bad-4525-8662-ca719e7995fd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:44.180695 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-64238270-7bad-4525-8662-ca719e7995fd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jan 19 16:32:44.181245 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 641/1392] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:44.507598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:44.508230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:44.514504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.514951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:44.515756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.516190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:44.574380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:44.581610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-855bd36f-528a-4e88-b75b-325eb9ddd1af tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077751 Jan 19 16:32:44.582181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 752/1393] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:44 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:44.909045 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ebfa2374-584d-4998-9a2b-68ebbe54d88f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:44.909956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ebfa2374-584d-4998-9a2b-68ebbe54d88f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:44.916331 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebfa2374-584d-4998-9a2b-68ebbe54d88f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.916790 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebfa2374-584d-4998-9a2b-68ebbe54d88f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:44.917570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebfa2374-584d-4998-9a2b-68ebbe54d88f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.918040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ebfa2374-584d-4998-9a2b-68ebbe54d88f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:44.945942 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ebfa2374-584d-4998-9a2b-68ebbe54d88f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Jan 19 16:32:44.946422 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 642/1394] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:44.984744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:44.985703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:44.992609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.992956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:44.993730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:44.994159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:45.123112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:45.131790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:45.133273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:45.134404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fea6059c-ae84-47f0-9a4f-2ba7b20ec253 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153449 Jan 19 16:32:45.134963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 753/1395] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:44 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:45.192448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-479c3e53-56a2-4d20-877e-32a2aafac275 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:45.193370 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-479c3e53-56a2-4d20-877e-32a2aafac275 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:45.199144 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-479c3e53-56a2-4d20-877e-32a2aafac275 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:45.199597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-479c3e53-56a2-4d20-877e-32a2aafac275 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:45.200431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-479c3e53-56a2-4d20-877e-32a2aafac275 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:45.200889 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-479c3e53-56a2-4d20-877e-32a2aafac275 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:45.229754 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-479c3e53-56a2-4d20-877e-32a2aafac275 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041092 Jan 19 16:32:45.230292 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 643/1396] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:45.598464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:45.598983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:45.605242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:45.605697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:45.606477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:45.606924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:45.665720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:45.673764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bc1fe502-6c95-44cc-a3a3-2cfeeccac158 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079164 Jan 19 16:32:45.674334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 754/1397] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:45 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:45.957202 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d6d7a9af-78b1-4296-b4d6-ffa0131386a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:45.958126 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d6d7a9af-78b1-4296-b4d6-ffa0131386a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:45.964573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6d7a9af-78b1-4296-b4d6-ffa0131386a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:45.965031 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6d7a9af-78b1-4296-b4d6-ffa0131386a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:45.965820 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6d7a9af-78b1-4296-b4d6-ffa0131386a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:45.966262 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d6d7a9af-78b1-4296-b4d6-ffa0131386a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:45.995873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d6d7a9af-78b1-4296-b4d6-ffa0131386a9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Jan 19 16:32:45.996429 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 644/1398] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:46.093326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:32:46.093568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:32:46.153052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:46.153651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:46.160537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:46.160981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:46.161751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:46.162180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:46.242105 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ed8bc12a-0bd7-4100-b678-8484c51b6c2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:46.243002 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ed8bc12a-0bd7-4100-b678-8484c51b6c2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:46.249420 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed8bc12a-0bd7-4100-b678-8484c51b6c2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:46.249872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed8bc12a-0bd7-4100-b678-8484c51b6c2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:46.250650 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed8bc12a-0bd7-4100-b678-8484c51b6c2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:46.251088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed8bc12a-0bd7-4100-b678-8484c51b6c2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:46.280789 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ed8bc12a-0bd7-4100-b678-8484c51b6c2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042316 Jan 19 16:32:46.281347 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 645/1399] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:46.291802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:46.300282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:46.301777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:46.302918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0ea7f4a0-ac38-4319-98ca-bd2092ac1610 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153545 Jan 19 16:32:46.303478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 755/1400] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:46 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:46.690730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:46.691342 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:46.697407 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:46.697861 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:46.698646 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:46.699088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:46.758806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:46.767984 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-82e07949-716a-48dc-811d-ebd99c0c8d9b tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080800 Jan 19 16:32:46.768557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 646/1401] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:46 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:47.007205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-35d7d7b1-510a-408e-a1c9-7d7fca8c1ee9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:47.008144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-35d7d7b1-510a-408e-a1c9-7d7fca8c1ee9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:47.015086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35d7d7b1-510a-408e-a1c9-7d7fca8c1ee9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.015539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35d7d7b1-510a-408e-a1c9-7d7fca8c1ee9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.016358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35d7d7b1-510a-408e-a1c9-7d7fca8c1ee9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.016829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-35d7d7b1-510a-408e-a1c9-7d7fca8c1ee9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.046132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-35d7d7b1-510a-408e-a1c9-7d7fca8c1ee9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042184 Jan 19 16:32:47.046687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 756/1402] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:47.292303 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b2378c69-282c-4866-a671-5a0a15e3e5e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:47.293128 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b2378c69-282c-4866-a671-5a0a15e3e5e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:47.299989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2378c69-282c-4866-a671-5a0a15e3e5e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.300443 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2378c69-282c-4866-a671-5a0a15e3e5e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.301208 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2378c69-282c-4866-a671-5a0a15e3e5e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.301644 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2378c69-282c-4866-a671-5a0a15e3e5e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.321251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:47.322004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:47.328393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.328845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.329660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.330096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.331954 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b2378c69-282c-4866-a671-5a0a15e3e5e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Jan 19 16:32:47.332510 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 647/1403] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:47.461315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:47.469557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:47.471027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:47.472188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-551161ce-99ff-41ab-ba5e-f755079b6c99 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154951 Jan 19 16:32:47.472742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 757/1404] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:47 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:47.785708 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:47.786319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:47.792299 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.792749 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.793539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:47.793976 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:47.853219 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:47.860757 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-24ac6058-c1cd-42ea-a759-7cbb0c10743f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078957 Jan 19 16:32:47.861320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 648/1405] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:47 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:48.057453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8a3f2b4e-8428-4460-8e20-2cf967c3840d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:48.058367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8a3f2b4e-8428-4460-8e20-2cf967c3840d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:48.065287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b4e-8428-4460-8e20-2cf967c3840d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.065743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b4e-8428-4460-8e20-2cf967c3840d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.066519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b4e-8428-4460-8e20-2cf967c3840d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.066960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b4e-8428-4460-8e20-2cf967c3840d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.100241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8a3f2b4e-8428-4460-8e20-2cf967c3840d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Jan 19 16:32:48.100807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 758/1406] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:48.343075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7c756559-997c-4e4e-b438-d684d3ff101c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:48.343952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7c756559-997c-4e4e-b438-d684d3ff101c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:48.350386 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c756559-997c-4e4e-b438-d684d3ff101c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.351272 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c756559-997c-4e4e-b438-d684d3ff101c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.351639 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c756559-997c-4e4e-b438-d684d3ff101c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.352089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7c756559-997c-4e4e-b438-d684d3ff101c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.365555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:32:48.365741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:32:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:32:48.387448 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7c756559-997c-4e4e-b438-d684d3ff101c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Jan 19 16:32:48.388058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 649/1407] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:48.490226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:48.490837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:48.496796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.497249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.498047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.499318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.632891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:48.642348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:48.643919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:48.645088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6fe540e3-2eb3-4b45-b7a5-c591a12eb52a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158626 Jan 19 16:32:48.645651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 759/1408] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:48 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:48.877917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:48.878542 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:48.884684 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.885054 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.885849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:48.886285 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:48.957086 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:48.970610 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-c70acf0b-5ceb-4952-9cc1-00513938a9ea tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.096486 Jan 19 16:32:48.971737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 650/1409] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:48 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:49.114792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4fefb4f-82ac-46b2-8561-438d82fdb87d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:49.115752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4fefb4f-82ac-46b2-8561-438d82fdb87d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:49.122377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fefb4f-82ac-46b2-8561-438d82fdb87d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:49.122827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fefb4f-82ac-46b2-8561-438d82fdb87d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:49.124340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fefb4f-82ac-46b2-8561-438d82fdb87d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:49.124791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fefb4f-82ac-46b2-8561-438d82fdb87d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:49.156197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4fefb4f-82ac-46b2-8561-438d82fdb87d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Jan 19 16:32:49.156942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 760/1410] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:49.399646 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-438c5ace-e37b-4673-8ffe-fcf3e4d5cb03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:49.400579 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-438c5ace-e37b-4673-8ffe-fcf3e4d5cb03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:49.407404 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-438c5ace-e37b-4673-8ffe-fcf3e4d5cb03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:49.407819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-438c5ace-e37b-4673-8ffe-fcf3e4d5cb03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:49.408601 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-438c5ace-e37b-4673-8ffe-fcf3e4d5cb03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:49.409037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-438c5ace-e37b-4673-8ffe-fcf3e4d5cb03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:49.444600 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-438c5ace-e37b-4673-8ffe-fcf3e4d5cb03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048726 Jan 19 16:32:49.445180 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 651/1411] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:49.664267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:49.664794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:49.671648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:49.672233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:49.673089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:49.673520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:49.812148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:49.820692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:49.822228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:49.823599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6f280d79-1831-4103-9fbf-bc39554a6798 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.163127 Jan 19 16:32:49.824193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 761/1412] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:49 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:49.991222 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:49.991872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:49.998017 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:49.998516 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:49.999895 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:50.000339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:50.063336 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:50.070752 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-7429cfe9-630d-4ec2-9500-89a87120ae35 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083148 Jan 19 16:32:50.071325 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 652/1413] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:49 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:50.168381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45483988-1ddf-44e1-8af8-256be4c98787 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:50.169308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45483988-1ddf-44e1-8af8-256be4c98787 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:50.176421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45483988-1ddf-44e1-8af8-256be4c98787 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:50.176876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45483988-1ddf-44e1-8af8-256be4c98787 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:50.177678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45483988-1ddf-44e1-8af8-256be4c98787 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:50.178114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45483988-1ddf-44e1-8af8-256be4c98787 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:50.208685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45483988-1ddf-44e1-8af8-256be4c98787 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044064 Jan 19 16:32:50.209260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 762/1414] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:50.455915 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-91b7205f-453e-472e-8406-91589985898a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:50.456827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-91b7205f-453e-472e-8406-91589985898a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:50.463143 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91b7205f-453e-472e-8406-91589985898a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:50.463587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91b7205f-453e-472e-8406-91589985898a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:50.464403 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91b7205f-453e-472e-8406-91589985898a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:50.464838 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-91b7205f-453e-472e-8406-91589985898a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:50.492907 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-91b7205f-453e-472e-8406-91589985898a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041428 Jan 19 16:32:50.493457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 653/1415] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:50.841107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:50.841717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:50.847785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:50.848241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:50.849014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:50.849453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:50.978059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:50.986887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:50.988405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:50.989538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cab1cd01-e16a-4956-9431-2fb8e7a104f1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.152158 Jan 19 16:32:50.990076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 763/1416] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:50 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:51.087109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:51.087740 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:51.094116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:51.094567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:51.095348 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:51.095813 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:51.154068 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:51.162356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b37bf23a-43f5-473b-aea5-adb1c801ed85 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078878 Jan 19 16:32:51.162922 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 654/1417] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:51 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:51.224585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ba643ff-f8fc-46a0-bf0b-e6b1a793daa3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:51.226128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ba643ff-f8fc-46a0-bf0b-e6b1a793daa3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:51.233623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ba643ff-f8fc-46a0-bf0b-e6b1a793daa3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:51.234081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ba643ff-f8fc-46a0-bf0b-e6b1a793daa3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:51.234875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ba643ff-f8fc-46a0-bf0b-e6b1a793daa3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:51.235311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ba643ff-f8fc-46a0-bf0b-e6b1a793daa3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:51.266708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ba643ff-f8fc-46a0-bf0b-e6b1a793daa3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049944 Jan 19 16:32:51.267296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 764/1418] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:51.504816 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1d372a70-c3a1-49ec-9332-869b07a54504 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:51.505944 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1d372a70-c3a1-49ec-9332-869b07a54504 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:51.512163 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d372a70-c3a1-49ec-9332-869b07a54504 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:51.512610 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d372a70-c3a1-49ec-9332-869b07a54504 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:51.513395 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d372a70-c3a1-49ec-9332-869b07a54504 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:51.514359 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1d372a70-c3a1-49ec-9332-869b07a54504 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:51.545172 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1d372a70-c3a1-49ec-9332-869b07a54504 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Jan 19 16:32:51.545723 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 655/1419] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:52.007787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:52.008447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:52.015860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.016310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.017554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.018035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.155589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:52.164008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:52.165510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:52.166650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-445da190-4b27-4c9a-b706-79c3d493e44d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162945 Jan 19 16:32:52.167202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 765/1420] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:52 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:52.179175 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:52.179810 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:52.185800 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.186784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.187585 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.188047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.246003 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:52.254011 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-54c2b964-63ec-43af-bac5-82b0696b573a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078449 Jan 19 16:32:52.254570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 656/1421] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:52 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:52.278057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-12a73db4-f0f7-4ea5-9b74-ceae3d6afd07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:52.278907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-12a73db4-f0f7-4ea5-9b74-ceae3d6afd07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:52.285017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12a73db4-f0f7-4ea5-9b74-ceae3d6afd07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.285471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12a73db4-f0f7-4ea5-9b74-ceae3d6afd07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.286245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12a73db4-f0f7-4ea5-9b74-ceae3d6afd07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.286680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12a73db4-f0f7-4ea5-9b74-ceae3d6afd07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.315623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-12a73db4-f0f7-4ea5-9b74-ceae3d6afd07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041263 Jan 19 16:32:52.316198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 766/1422] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:52.556089 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4e8f6eb6-509c-43a4-a85c-24d5783a6ba1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:52.556917 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4e8f6eb6-509c-43a4-a85c-24d5783a6ba1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:52.563699 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e8f6eb6-509c-43a4-a85c-24d5783a6ba1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.564161 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e8f6eb6-509c-43a4-a85c-24d5783a6ba1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.564937 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e8f6eb6-509c-43a4-a85c-24d5783a6ba1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:52.565377 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4e8f6eb6-509c-43a4-a85c-24d5783a6ba1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:52.594539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4e8f6eb6-509c-43a4-a85c-24d5783a6ba1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042282 Jan 19 16:32:52.595087 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 657/1423] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:53.186808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:53.187515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:53.194441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.194897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.195702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.196149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.270101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:53.270701 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:53.276490 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.276936 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.277706 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.278729 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.351217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:53.354782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:53.359442 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-bc24c5ac-fdcf-46f5-807c-89a3b5c1aeaa tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.092973 Jan 19 16:32:53.360044 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 658/1424] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:53 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:53.363780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:53.364406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-98461c3c-ed61-4030-a7bf-6691749fc52a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:53.365259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:53.365535 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-98461c3c-ed61-4030-a7bf-6691749fc52a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:53.366737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-917704ec-b8ea-4aa0-a83c-017824b2fa3e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.184765 Jan 19 16:32:53.367384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 767/1425] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:53 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:53.371288 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98461c3c-ed61-4030-a7bf-6691749fc52a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.371773 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98461c3c-ed61-4030-a7bf-6691749fc52a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.372557 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98461c3c-ed61-4030-a7bf-6691749fc52a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.373000 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-98461c3c-ed61-4030-a7bf-6691749fc52a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.401404 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-98461c3c-ed61-4030-a7bf-6691749fc52a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040352 Jan 19 16:32:53.401957 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 659/1426] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:53.605383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6d9f8314-7632-447f-bc43-0c9e7be39c23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:53.606297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6d9f8314-7632-447f-bc43-0c9e7be39c23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:53.612851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9f8314-7632-447f-bc43-0c9e7be39c23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.613304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9f8314-7632-447f-bc43-0c9e7be39c23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.614082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9f8314-7632-447f-bc43-0c9e7be39c23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:53.614522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d9f8314-7632-447f-bc43-0c9e7be39c23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:53.643606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6d9f8314-7632-447f-bc43-0c9e7be39c23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Jan 19 16:32:53.644187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 768/1427] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:54.376649 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:54.377249 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:54.383827 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.384278 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.385048 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.385155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:54.385604 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.385735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:54.392277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.392738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.393529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.393967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.465040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:54.472508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ffafaa4d-1eff-487a-8eab-e5f1de6a9734 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.100032 Jan 19 16:32:54.473086 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 660/1428] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:54 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:54.477587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d207bf3c-701d-46ff-a0d1-f617d1707ad4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:54.478502 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d207bf3c-701d-46ff-a0d1-f617d1707ad4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:54.485873 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d207bf3c-701d-46ff-a0d1-f617d1707ad4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.486320 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d207bf3c-701d-46ff-a0d1-f617d1707ad4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.487102 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d207bf3c-701d-46ff-a0d1-f617d1707ad4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.487534 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d207bf3c-701d-46ff-a0d1-f617d1707ad4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.517624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d207bf3c-701d-46ff-a0d1-f617d1707ad4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Jan 19 16:32:54.518184 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 661/1429] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:54.654624 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ed4df079-d73a-4be7-b2ee-d051479b1254 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:54.655570 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ed4df079-d73a-4be7-b2ee-d051479b1254 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:54.662345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4df079-d73a-4be7-b2ee-d051479b1254 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.662853 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4df079-d73a-4be7-b2ee-d051479b1254 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.663706 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4df079-d73a-4be7-b2ee-d051479b1254 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:54.664145 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ed4df079-d73a-4be7-b2ee-d051479b1254 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:54.699402 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ed4df079-d73a-4be7-b2ee-d051479b1254 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048690 Jan 19 16:32:54.703574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 662/1430] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:54.757695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:54.766687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:54.768210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:54.769358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cb79f286-e211-4ffb-b2c4-fb59d6b0e426 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.387918 Jan 19 16:32:54.769906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 769/1431] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:54 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:55.489531 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:55.490140 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:55.496654 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.497111 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.497902 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.498345 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.534431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d87a9cfa-3247-42b8-98b4-ed273642cfd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:55.535436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d87a9cfa-3247-42b8-98b4-ed273642cfd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:55.542649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d87a9cfa-3247-42b8-98b4-ed273642cfd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.543108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d87a9cfa-3247-42b8-98b4-ed273642cfd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.543937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d87a9cfa-3247-42b8-98b4-ed273642cfd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.544383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d87a9cfa-3247-42b8-98b4-ed273642cfd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.559567 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:55.567117 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-28510e1a-428c-4d30-95b0-59e50bd33052 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081180 Jan 19 16:32:55.567767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 663/1432] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:55 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:55.575216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d87a9cfa-3247-42b8-98b4-ed273642cfd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045957 Jan 19 16:32:55.575807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 770/1433] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:55.710989 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-562c8c2f-e9c7-4776-89d1-ea0696a5ff5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:55.711941 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-562c8c2f-e9c7-4776-89d1-ea0696a5ff5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:55.718527 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-562c8c2f-e9c7-4776-89d1-ea0696a5ff5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.718981 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-562c8c2f-e9c7-4776-89d1-ea0696a5ff5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.719824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-562c8c2f-e9c7-4776-89d1-ea0696a5ff5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.720270 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-562c8c2f-e9c7-4776-89d1-ea0696a5ff5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.751952 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-562c8c2f-e9c7-4776-89d1-ea0696a5ff5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Jan 19 16:32:55.752445 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 664/1434] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:55.788629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:55.789261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:55.795995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.796448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.797245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:55.797684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:55.934088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:55.942903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:55.944447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:55.945597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5b55c1c6-bb7b-4841-817b-2c0c46a8c493 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.160699 Jan 19 16:32:55.946145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 771/1435] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:55 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:56.583874 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:56.584630 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:56.586460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-36b18932-7b7d-4d43-a17f-27207e1aeea0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:56.587392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-36b18932-7b7d-4d43-a17f-27207e1aeea0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:56.591326 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.591807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:56.592621 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.593061 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:56.594158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36b18932-7b7d-4d43-a17f-27207e1aeea0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.594622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36b18932-7b7d-4d43-a17f-27207e1aeea0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:56.595426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36b18932-7b7d-4d43-a17f-27207e1aeea0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.595911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36b18932-7b7d-4d43-a17f-27207e1aeea0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:56.628878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-36b18932-7b7d-4d43-a17f-27207e1aeea0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046028 Jan 19 16:32:56.629691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 772/1436] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:32:56.661682 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:56.669478 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-92b8060c-ca44-46f1-ad8b-b67d0cd40729 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.089303 Jan 19 16:32:56.670573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 665/1437] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:56 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:56.763645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dbb10ef7-16d5-43b8-a2b8-e2610c3f4a1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:56.764876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dbb10ef7-16d5-43b8-a2b8-e2610c3f4a1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:56.771476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb10ef7-16d5-43b8-a2b8-e2610c3f4a1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.772061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb10ef7-16d5-43b8-a2b8-e2610c3f4a1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:56.772914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb10ef7-16d5-43b8-a2b8-e2610c3f4a1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.773405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb10ef7-16d5-43b8-a2b8-e2610c3f4a1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:56.804521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dbb10ef7-16d5-43b8-a2b8-e2610c3f4a1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Jan 19 16:32:56.805095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 773/1438] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:56.964454 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:56.965051 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:56.971588 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.972074 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:56.972849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:56.973309 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:57.114074 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:57.122881 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:57.124468 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:57.126052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b2fb8c94-d4d9-4df7-9980-55defbb0bddc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165215 Jan 19 16:32:57.126628 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 666/1439] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:56 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:32:57.642279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fb1f1ddd-e930-46cc-b677-ed0cd8dd7838 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:57.643106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fb1f1ddd-e930-46cc-b677-ed0cd8dd7838 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:57.649878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb1f1ddd-e930-46cc-b677-ed0cd8dd7838 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:57.650349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb1f1ddd-e930-46cc-b677-ed0cd8dd7838 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:57.651147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb1f1ddd-e930-46cc-b677-ed0cd8dd7838 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:57.651586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb1f1ddd-e930-46cc-b677-ed0cd8dd7838 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:57.683419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fb1f1ddd-e930-46cc-b677-ed0cd8dd7838 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Jan 19 16:32:57.684263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 774/1440] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:57.687015 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:57.687632 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:57.694208 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:57.694663 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:57.695457 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:57.695922 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:57.757982 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:57.768356 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-071529b0-6cc5-4559-9c3e-9aabf898f5ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.085553 Jan 19 16:32:57.768956 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 667/1441] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:57 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:32:57.820314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7b4d2b68-db71-4926-94ac-a7a85f020c0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:57.821959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7b4d2b68-db71-4926-94ac-a7a85f020c0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:57.832861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b4d2b68-db71-4926-94ac-a7a85f020c0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:57.833676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b4d2b68-db71-4926-94ac-a7a85f020c0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:57.835092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b4d2b68-db71-4926-94ac-a7a85f020c0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:57.835929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b4d2b68-db71-4926-94ac-a7a85f020c0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:57.867828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7b4d2b68-db71-4926-94ac-a7a85f020c0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053688 Jan 19 16:32:57.868408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 775/1442] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:58.144449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:58.145060 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:58.151093 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.151546 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.152378 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.152817 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.290283 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:58.299231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:58.300896 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:58.302041 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-32cc592b-2c88-4c0f-b8b7-fd5166e42da9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161428 Jan 19 16:32:58.302595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 668/1443] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:58 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:58.695465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b13e2ec6-ad1c-437c-9f5d-e5e7977d1580 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:58.696685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b13e2ec6-ad1c-437c-9f5d-e5e7977d1580 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:58.704118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b13e2ec6-ad1c-437c-9f5d-e5e7977d1580 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.704573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b13e2ec6-ad1c-437c-9f5d-e5e7977d1580 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.705361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b13e2ec6-ad1c-437c-9f5d-e5e7977d1580 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.705801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b13e2ec6-ad1c-437c-9f5d-e5e7977d1580 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.739186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b13e2ec6-ad1c-437c-9f5d-e5e7977d1580 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 Jan 19 16:32:58.739797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 776/1444] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:58.792029 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:58.792642 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:58.799788 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.800236 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.801024 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.801453 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.861769 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:58.869152 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-cf0f0d7e-35f0-4f7b-8816-d5ba725f4170 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081860 Jan 19 16:32:58.869711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 669/1445] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:58 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:58.878120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-28f9eb17-a355-42e6-bc79-03a3ddd9047b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:58.879040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-28f9eb17-a355-42e6-bc79-03a3ddd9047b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:58.885007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28f9eb17-a355-42e6-bc79-03a3ddd9047b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.885460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28f9eb17-a355-42e6-bc79-03a3ddd9047b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.886269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28f9eb17-a355-42e6-bc79-03a3ddd9047b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:58.886785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28f9eb17-a355-42e6-bc79-03a3ddd9047b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:58.916923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-28f9eb17-a355-42e6-bc79-03a3ddd9047b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042463 Jan 19 16:32:58.917476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 777/1446] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:59.320744 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:59.321361 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:59.327837 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.328290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.329100 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.329541 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.456489 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:59.465878 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:59.466762 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:59.467940 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-a9a7e59a-6874-4c1e-80de-114ac9f9f1b3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150853 Jan 19 16:32:59.468495 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 670/1447] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:32:59 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:32:59.751196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-351f7db6-4605-45e6-9732-4d1f3abdc80e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:59.752266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-351f7db6-4605-45e6-9732-4d1f3abdc80e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:59.758420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351f7db6-4605-45e6-9732-4d1f3abdc80e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.758874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351f7db6-4605-45e6-9732-4d1f3abdc80e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.759657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351f7db6-4605-45e6-9732-4d1f3abdc80e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.760119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351f7db6-4605-45e6-9732-4d1f3abdc80e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.788959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-351f7db6-4605-45e6-9732-4d1f3abdc80e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Jan 19 16:32:59.789520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 778/1448] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:32:59.884965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:59.885564 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:59.891978 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.892431 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.893217 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.893652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.928337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c6f3962-7d8c-4a53-8501-600063e5d91a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:32:59.929429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8c6f3962-7d8c-4a53-8501-600063e5d91a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:32:59.936767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c6f3962-7d8c-4a53-8501-600063e5d91a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.937139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c6f3962-7d8c-4a53-8501-600063e5d91a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.937973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c6f3962-7d8c-4a53-8501-600063e5d91a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:32:59.938409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c6f3962-7d8c-4a53-8501-600063e5d91a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:32:59.953526 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:32:59.961146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1ed48a5e-2a01-41ff-8ff2-7b5856544e25 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079564 Jan 19 16:32:59.961987 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 671/1449] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:32:59 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:32:59.970122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8c6f3962-7d8c-4a53-8501-600063e5d91a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 Jan 19 16:32:59.970930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 779/1450] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:32:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:00.485811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:00.486488 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:00.492599 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.493048 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:00.493833 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.494268 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:00.625539 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:00.633530 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:00.634997 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:00.636157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8a530c90-dd48-4a02-9c24-60e797e74d21 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.154065 Jan 19 16:33:00.636708 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 672/1451] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:00 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:33:00.800326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5d335c8b-2284-4e2a-b0b2-6fedcb819f8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:00.801256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5d335c8b-2284-4e2a-b0b2-6fedcb819f8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:00.807488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d335c8b-2284-4e2a-b0b2-6fedcb819f8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.807983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d335c8b-2284-4e2a-b0b2-6fedcb819f8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:00.808761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d335c8b-2284-4e2a-b0b2-6fedcb819f8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.809202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d335c8b-2284-4e2a-b0b2-6fedcb819f8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:00.838659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5d335c8b-2284-4e2a-b0b2-6fedcb819f8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 Jan 19 16:33:00.839232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 780/1452] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:00.978144 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:00.978758 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:00.981253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8fde627f-0445-49a9-a58e-0eb0097f1f0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:00.982188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8fde627f-0445-49a9-a58e-0eb0097f1f0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:00.985151 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.985605 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:00.986389 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.986829 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:00.988102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fde627f-0445-49a9-a58e-0eb0097f1f0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.988561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fde627f-0445-49a9-a58e-0eb0097f1f0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:00.989349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fde627f-0445-49a9-a58e-0eb0097f1f0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:00.989792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fde627f-0445-49a9-a58e-0eb0097f1f0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:01.019504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8fde627f-0445-49a9-a58e-0eb0097f1f0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041940 Jan 19 16:33:01.020098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 781/1453] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:01.048327 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:01.057052 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-11588d35-a051-4304-9cc3-36c50310cfaf tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082638 Jan 19 16:33:01.057626 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 673/1454] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:00 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:01.655271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:01.656104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:01.662484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:01.662950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:01.663849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:01.664196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:01.809394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:01.818690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:01.820223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:01.821390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-89a855a4-dc36-4871-b9ac-7e4d6e306a37 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.170356 Jan 19 16:33:01.821955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 782/1455] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:01 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:33:01.850181 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-2b35dc24-b34b-4da5-bb71-6a134822d483 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:01.851096 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-2b35dc24-b34b-4da5-bb71-6a134822d483 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:01.857035 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b35dc24-b34b-4da5-bb71-6a134822d483 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:01.858018 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b35dc24-b34b-4da5-bb71-6a134822d483 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:01.858807 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b35dc24-b34b-4da5-bb71-6a134822d483 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:01.859244 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-2b35dc24-b34b-4da5-bb71-6a134822d483 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:01.889394 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-2b35dc24-b34b-4da5-bb71-6a134822d483 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042387 Jan 19 16:33:01.889967 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 674/1456] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:02.032546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-512eeb49-377c-4e5d-b93d-46a524c232b6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:02.033503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-512eeb49-377c-4e5d-b93d-46a524c232b6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:02.039497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-512eeb49-377c-4e5d-b93d-46a524c232b6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.039984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-512eeb49-377c-4e5d-b93d-46a524c232b6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.040802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-512eeb49-377c-4e5d-b93d-46a524c232b6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.041244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-512eeb49-377c-4e5d-b93d-46a524c232b6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.070216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-512eeb49-377c-4e5d-b93d-46a524c232b6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Jan 19 16:33:02.070869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 783/1457] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:02.074231 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:02.074870 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:02.081747 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.082196 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.082986 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.083423 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.146694 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:02.154811 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-ef13744e-82a4-4e4b-ae0f-b52035bb5882 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.083649 Jan 19 16:33:02.155430 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 675/1458] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:02 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:02.839801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:02.840393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:02.847363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.847860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.848643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.849142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.900668 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-b3bd8f13-74ae-4420-a485-9044e0ba6ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:02.901573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-b3bd8f13-74ae-4420-a485-9044e0ba6ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:02.908428 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b3bd8f13-74ae-4420-a485-9044e0ba6ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.908880 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b3bd8f13-74ae-4420-a485-9044e0ba6ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.909652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b3bd8f13-74ae-4420-a485-9044e0ba6ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:02.910086 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-b3bd8f13-74ae-4420-a485-9044e0ba6ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:02.939433 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-b3bd8f13-74ae-4420-a485-9044e0ba6ca8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Jan 19 16:33:02.940199 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 676/1459] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:02.983657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:02.991867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:02.993350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:02.994478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-943770c4-38ee-414b-a6b0-ec343d63858f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158551 Jan 19 16:33:02.995024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 784/1460] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:02 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:33:03.081127 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-e66e273b-ca44-4fbc-acaf-fdceddc738e4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:03.082070 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-e66e273b-ca44-4fbc-acaf-fdceddc738e4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:03.088412 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e66e273b-ca44-4fbc-acaf-fdceddc738e4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:03.088872 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e66e273b-ca44-4fbc-acaf-fdceddc738e4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:03.089646 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e66e273b-ca44-4fbc-acaf-fdceddc738e4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:03.090090 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-e66e273b-ca44-4fbc-acaf-fdceddc738e4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:03.118709 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-e66e273b-ca44-4fbc-acaf-fdceddc738e4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Jan 19 16:33:03.119276 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 677/1461] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:03.171352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:03.171991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:03.177927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:03.178383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:03.179168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:03.179604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:03.238226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:03.245563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-93d66576-78f1-45af-8432-93e6bb38b764 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.077943 Jan 19 16:33:03.246161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 785/1462] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:03 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:03.950733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-11073ecf-e100-4738-8ae0-4824b2f42caf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:03.951661 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-11073ecf-e100-4738-8ae0-4824b2f42caf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:03.957666 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11073ecf-e100-4738-8ae0-4824b2f42caf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:03.958122 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11073ecf-e100-4738-8ae0-4824b2f42caf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:03.958942 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11073ecf-e100-4738-8ae0-4824b2f42caf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:03.959390 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-11073ecf-e100-4738-8ae0-4824b2f42caf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:03.989480 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-11073ecf-e100-4738-8ae0-4824b2f42caf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Jan 19 16:33:03.990057 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 678/1463] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:04.014174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:04.014782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:04.021176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:04.021630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:04.022418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:04.022855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:04.130221 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-863f358f-bab0-4c45-9ea4-53df510a9399 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:04.131141 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-863f358f-bab0-4c45-9ea4-53df510a9399 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:04.137652 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f358f-bab0-4c45-9ea4-53df510a9399 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:04.138109 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f358f-bab0-4c45-9ea4-53df510a9399 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:04.139406 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f358f-bab0-4c45-9ea4-53df510a9399 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:04.139885 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-863f358f-bab0-4c45-9ea4-53df510a9399 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:04.160876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:04.169373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:04.170914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:04.171177 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-863f358f-bab0-4c45-9ea4-53df510a9399 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Jan 19 16:33:04.171769 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 679/1464] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:04.172093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dbb24f3b-c4e4-456e-be2b-df87085a154e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162039 Jan 19 16:33:04.172645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 786/1465] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:04 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:33:04.262638 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:04.263203 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:04.269773 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:04.270220 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:04.271000 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:04.271486 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:04.332108 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:04.339458 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d9deecc5-4270-4881-920c-f4c2418676f2 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.080570 Jan 19 16:33:04.340058 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 680/1466] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:04 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:05.001648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-539272da-2f02-40e3-8649-5aa0c5e2b04a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:05.002565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-539272da-2f02-40e3-8649-5aa0c5e2b04a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:05.008453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-539272da-2f02-40e3-8649-5aa0c5e2b04a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.008910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-539272da-2f02-40e3-8649-5aa0c5e2b04a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.009691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-539272da-2f02-40e3-8649-5aa0c5e2b04a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.010128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-539272da-2f02-40e3-8649-5aa0c5e2b04a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.038247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-539272da-2f02-40e3-8649-5aa0c5e2b04a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040931 Jan 19 16:33:05.038887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 787/1467] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:05.182446 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-07dd5b76-cf51-406c-8d26-aaaa6133fe99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:05.183357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-07dd5b76-cf51-406c-8d26-aaaa6133fe99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:05.190401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:05.190610 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07dd5b76-cf51-406c-8d26-aaaa6133fe99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.191002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:05.191139 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07dd5b76-cf51-406c-8d26-aaaa6133fe99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.191819 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07dd5b76-cf51-406c-8d26-aaaa6133fe99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.192263 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-07dd5b76-cf51-406c-8d26-aaaa6133fe99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.197054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.198094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.198276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.198707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.223994 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-07dd5b76-cf51-406c-8d26-aaaa6133fe99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Jan 19 16:33:05.224572 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 681/1468] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:05.332265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:05.341249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:05.343260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:05.344453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-47b8407b-c15e-4bd9-8e61-cab7570035b6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157645 Jan 19 16:33:05.345008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 788/1469] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:05 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:05.356573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:05.357786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:05.363991 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.364442 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.365232 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:05.365690 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:05.431928 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:05.440103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-8c772994-5f60-4a0f-8646-946f0bb400e3 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087375 Jan 19 16:33:05.440678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 682/1470] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:05 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:06.050319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2831434a-dd5a-409a-8fd9-cd2b9dfab326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:06.051475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2831434a-dd5a-409a-8fd9-cd2b9dfab326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:06.059417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2831434a-dd5a-409a-8fd9-cd2b9dfab326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.059898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2831434a-dd5a-409a-8fd9-cd2b9dfab326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.060672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2831434a-dd5a-409a-8fd9-cd2b9dfab326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.061107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2831434a-dd5a-409a-8fd9-cd2b9dfab326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.089225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2831434a-dd5a-409a-8fd9-cd2b9dfab326 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Jan 19 16:33:06.089770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 789/1471] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:06.236168 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-93e68476-c33f-4ee6-8aa1-96c25ab86c48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:06.237080 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-93e68476-c33f-4ee6-8aa1-96c25ab86c48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:06.243399 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93e68476-c33f-4ee6-8aa1-96c25ab86c48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.243891 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93e68476-c33f-4ee6-8aa1-96c25ab86c48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.244671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93e68476-c33f-4ee6-8aa1-96c25ab86c48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.245114 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-93e68476-c33f-4ee6-8aa1-96c25ab86c48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.273254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-93e68476-c33f-4ee6-8aa1-96c25ab86c48 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Jan 19 16:33:06.273802 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 683/1472] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:06.363007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:06.363564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:06.369903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.370420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.371107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.371536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.458040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:06.458656 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:06.464786 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.465296 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.466097 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:06.467135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:06.514410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:06.523659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:06.525181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:06.526416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fafa0851-dae8-4d71-ba10-325205a454ae tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.167230 Jan 19 16:33:06.527001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 790/1473] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:06 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:33:06.536033 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:06.543582 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-39d0ab4f-c552-44cb-9c3d-9ffa09108cf9 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.089917 Jan 19 16:33:06.544215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 684/1474] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:06 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:07.101432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c41875e6-1258-4b30-b043-3e63b96b8b16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:07.102837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c41875e6-1258-4b30-b043-3e63b96b8b16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:07.109447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c41875e6-1258-4b30-b043-3e63b96b8b16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.109905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c41875e6-1258-4b30-b043-3e63b96b8b16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.110687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c41875e6-1258-4b30-b043-3e63b96b8b16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.111131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c41875e6-1258-4b30-b043-3e63b96b8b16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.141624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c41875e6-1258-4b30-b043-3e63b96b8b16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Jan 19 16:33:07.142210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 791/1475] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:07.285103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9584b585-2061-4440-83ca-df8c52357c9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:07.286008 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9584b585-2061-4440-83ca-df8c52357c9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:07.292449 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9584b585-2061-4440-83ca-df8c52357c9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.292899 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9584b585-2061-4440-83ca-df8c52357c9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.293678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9584b585-2061-4440-83ca-df8c52357c9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.294112 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9584b585-2061-4440-83ca-df8c52357c9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.323113 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9584b585-2061-4440-83ca-df8c52357c9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 Jan 19 16:33:07.323752 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 685/1476] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:07.545635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:07.546333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:07.552515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.552970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.553785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.554251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.560655 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:07.561424 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:07.567268 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.567755 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.568548 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:07.568991 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:07.646503 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:07.654148 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-da30e304-7bc2-40cb-a5bd-466999ea0dee tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.097532 Jan 19 16:33:07.654733 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 686/1477] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:07 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:33:07.717291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:07.725654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:07.727137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:07.728337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-12547680-4f51-40aa-a823-01db9b183e1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.186595 Jan 19 16:33:07.728895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 792/1478] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:07 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:08.153144 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-3ba9db63-5348-44e7-b846-cc28ca823cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:08.154215 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-3ba9db63-5348-44e7-b846-cc28ca823cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:08.160640 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ba9db63-5348-44e7-b846-cc28ca823cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.161088 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ba9db63-5348-44e7-b846-cc28ca823cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.161898 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ba9db63-5348-44e7-b846-cc28ca823cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.162333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-3ba9db63-5348-44e7-b846-cc28ca823cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.192341 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-3ba9db63-5348-44e7-b846-cc28ca823cfa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042890 Jan 19 16:33:08.192919 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 687/1479] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:08.335990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-960cb4bc-ac3b-426c-856b-f37d10642a55 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:08.336901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-960cb4bc-ac3b-426c-856b-f37d10642a55 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:08.343520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-960cb4bc-ac3b-426c-856b-f37d10642a55 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.344012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-960cb4bc-ac3b-426c-856b-f37d10642a55 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.344788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-960cb4bc-ac3b-426c-856b-f37d10642a55 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.345231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-960cb4bc-ac3b-426c-856b-f37d10642a55 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.374297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-960cb4bc-ac3b-426c-856b-f37d10642a55 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 Jan 19 16:33:08.374848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 793/1480] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:08.670774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:08.671574 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:08.677885 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.678330 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.679107 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.679563 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.737743 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:08.745444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-4a2d7ed9-0da5-4f6d-8075-acfb8795c8bc tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.078932 Jan 19 16:33:08.746417 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 688/1481] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:08 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:08.746602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:08.747100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:08.753991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.754594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.755244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:08.755745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:08.885713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:08.893922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:08.895407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:08.896598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6dcd545f-ecf0-4fed-9301-97991740be08 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.153978 Jan 19 16:33:08.897160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 794/1482] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:08 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:09.203938 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1825299c-1ab6-45b9-9168-fd61252aec67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:09.204860 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1825299c-1ab6-45b9-9168-fd61252aec67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:09.210958 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1825299c-1ab6-45b9-9168-fd61252aec67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.211415 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1825299c-1ab6-45b9-9168-fd61252aec67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.212233 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1825299c-1ab6-45b9-9168-fd61252aec67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.212678 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1825299c-1ab6-45b9-9168-fd61252aec67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.243538 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1825299c-1ab6-45b9-9168-fd61252aec67 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Jan 19 16:33:09.244128 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 689/1483] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:09.385550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1b7c8fad-f83e-4058-9ce2-c7d889ee03bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:09.386465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1b7c8fad-f83e-4058-9ce2-c7d889ee03bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:09.393347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b7c8fad-f83e-4058-9ce2-c7d889ee03bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.393806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b7c8fad-f83e-4058-9ce2-c7d889ee03bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.394633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b7c8fad-f83e-4058-9ce2-c7d889ee03bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.395029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b7c8fad-f83e-4058-9ce2-c7d889ee03bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.424148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1b7c8fad-f83e-4058-9ce2-c7d889ee03bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Jan 19 16:33:09.424703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 795/1484] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:09.765562 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:09.766157 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:09.772126 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.772575 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.773404 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.773785 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.834414 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:09.843460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-1363cf8f-69a2-433e-a70c-8029330fc859 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.082816 Jan 19 16:33:09.844075 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 690/1485] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:09 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:09.914981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:09.915635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:09.922389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.922850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.923641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:09.924114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:09.964173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:33:09.964424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:33:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 (ip 10.222.0.42) !!! Jan 19 16:33:10.056914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:10.065475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:10.066903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:10.068099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8f078466-7939-4e7f-8eb8-b3d83ff75430 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156848 Jan 19 16:33:10.068656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 796/1486] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:09 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:33:10.255069 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-d8417bac-dd59-449c-a9d7-5a63cf7d27c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:10.255982 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-d8417bac-dd59-449c-a9d7-5a63cf7d27c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:10.262254 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d8417bac-dd59-449c-a9d7-5a63cf7d27c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:10.262711 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d8417bac-dd59-449c-a9d7-5a63cf7d27c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:10.263490 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d8417bac-dd59-449c-a9d7-5a63cf7d27c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:10.263950 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-d8417bac-dd59-449c-a9d7-5a63cf7d27c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:10.292537 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-d8417bac-dd59-449c-a9d7-5a63cf7d27c4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041272 Jan 19 16:33:10.293113 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 691/1487] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:10.436301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3d1290ab-10b5-49cc-8dfe-587148007b95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:10.437215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3d1290ab-10b5-49cc-8dfe-587148007b95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:10.443483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d1290ab-10b5-49cc-8dfe-587148007b95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:10.443965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d1290ab-10b5-49cc-8dfe-587148007b95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:10.444742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d1290ab-10b5-49cc-8dfe-587148007b95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:10.445177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d1290ab-10b5-49cc-8dfe-587148007b95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:10.474217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3d1290ab-10b5-49cc-8dfe-587148007b95 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Jan 19 16:33:10.474770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 797/1488] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:10.860429 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:10.861040 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:10.867061 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:10.867518 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:10.868333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:10.868774 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:10.936098 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.policy [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116209) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:10.943587 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-9de3de71-a347-4c9b-b639-6b27abe01115 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.087335 Jan 19 16:33:10.944187 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 692/1489] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:33:10 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:33:11.086378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:11.086977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:11.093907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.094353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:11.095124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.095556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:11.226847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:11.235380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:11.236896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:11.238032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-33970adf-858b-4f4f-ada7-7fc198ae4c38 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155401 Jan 19 16:33:11.238583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 798/1490] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:11 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:33:11.304444 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-66272fab-b35e-434a-8c54-9b62f5587133 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:11.305364 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-66272fab-b35e-434a-8c54-9b62f5587133 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:11.312586 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66272fab-b35e-434a-8c54-9b62f5587133 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.313037 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66272fab-b35e-434a-8c54-9b62f5587133 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:11.314103 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66272fab-b35e-434a-8c54-9b62f5587133 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.314556 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-66272fab-b35e-434a-8c54-9b62f5587133 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:11.345726 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO nova.api.openstack.requestlog [None req-66272fab-b35e-434a-8c54-9b62f5587133 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 Jan 19 16:33:11.346290 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: [pid: 116209|app: 0|req: 693/1491] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:11.484880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2f4d6ea6-4a1b-48fa-a4d1-434fdcff7f75 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:11.485846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2f4d6ea6-4a1b-48fa-a4d1-434fdcff7f75 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:11.492168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f4d6ea6-4a1b-48fa-a4d1-434fdcff7f75 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.492605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f4d6ea6-4a1b-48fa-a4d1-434fdcff7f75 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:11.493384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f4d6ea6-4a1b-48fa-a4d1-434fdcff7f75 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.493815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f4d6ea6-4a1b-48fa-a4d1-434fdcff7f75 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:11.524948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2f4d6ea6-4a1b-48fa-a4d1-434fdcff7f75 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Jan 19 16:33:11.525995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 799/1492] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:11.960651 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.api.openstack.wsgi [None req-668e62fb-c47a-4446-9d1f-80109fae5082 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:11.961287 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG nova.compute.api [None req-668e62fb-c47a-4446-9d1f-80109fae5082 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116209) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:11.967806 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-668e62fb-c47a-4446-9d1f-80109fae5082 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.968286 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-668e62fb-c47a-4446-9d1f-80109fae5082 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:11.969071 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-668e62fb-c47a-4446-9d1f-80109fae5082 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:11.969508 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: DEBUG oslo_concurrency.lockutils [None req-668e62fb-c47a-4446-9d1f-80109fae5082 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:12.024784 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:33:12.027767 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:33:12.039146 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Traceback (most recent call last): Jan 19 16:33:12.039316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 19 16:33:12.039316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: timer() Jan 19 16:33:12.039316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 19 16:33:12.039316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: cb(*args, **kw) Jan 19 16:33:12.039316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jan 19 16:33:12.039316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: waiter.switch() Jan 19 16:33:12.039316 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: greenlet.error: cannot switch to a different thread Jan 19 16:33:12.257227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:12.257748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:12.263913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:12.264376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:12.265161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:12.265602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:12.404844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:12.413494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:12.414987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:12.416173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9157df6a-ce81-4ce9-9d99-3da627e7619f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.162831 Jan 19 16:33:12.416729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 800/1493] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:12 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:12.421096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fccec10f-c8b7-4513-bbc7-17363c41f6e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:12.422007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fccec10f-c8b7-4513-bbc7-17363c41f6e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:12.428172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccec10f-c8b7-4513-bbc7-17363c41f6e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:12.428623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccec10f-c8b7-4513-bbc7-17363c41f6e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:12.429438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccec10f-c8b7-4513-bbc7-17363c41f6e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:12.429884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fccec10f-c8b7-4513-bbc7-17363c41f6e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:12.460255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fccec10f-c8b7-4513-bbc7-17363c41f6e4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Jan 19 16:33:12.460816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 801/1494] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:12.524007 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:33:12.524287 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:33:12.536843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6e4bf98a-c456-4f26-b75a-c143746cbd99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:12.537780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6e4bf98a-c456-4f26-b75a-c143746cbd99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:12.544131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e4bf98a-c456-4f26-b75a-c143746cbd99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:12.544603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e4bf98a-c456-4f26-b75a-c143746cbd99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:12.545386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e4bf98a-c456-4f26-b75a-c143746cbd99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:12.545819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e4bf98a-c456-4f26-b75a-c143746cbd99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:12.575113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6e4bf98a-c456-4f26-b75a-c143746cbd99 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Jan 19 16:33:12.576226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 802/1495] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:13.434266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:13.434879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:13.440850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:13.441306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:13.442087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:13.442522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:13.575850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:13.584586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:13.586102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:13.587282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ea74d061-fca0-4de4-a029-d2bf2dd5659f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.156746 Jan 19 16:33:13.587912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 803/1496] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:13.592770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d0811ed3-df49-4ca4-ac72-c1d4a9091aeb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:13.593668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0811ed3-df49-4ca4-ac72-c1d4a9091aeb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:13.599505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0811ed3-df49-4ca4-ac72-c1d4a9091aeb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:13.599993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0811ed3-df49-4ca4-ac72-c1d4a9091aeb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:13.600784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0811ed3-df49-4ca4-ac72-c1d4a9091aeb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:13.601224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0811ed3-df49-4ca4-ac72-c1d4a9091aeb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:13.630152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d0811ed3-df49-4ca4-ac72-c1d4a9091aeb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 Jan 19 16:33:13.630934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 804/1497] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:13.634917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9314f884-67fb-4db2-a4b8-31604dff9ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:13.635844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9314f884-67fb-4db2-a4b8-31604dff9ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:13.641217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9314f884-67fb-4db2-a4b8-31604dff9ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:13.641673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9314f884-67fb-4db2-a4b8-31604dff9ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:13.642444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9314f884-67fb-4db2-a4b8-31604dff9ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:13.642892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9314f884-67fb-4db2-a4b8-31604dff9ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:13.672422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9314f884-67fb-4db2-a4b8-31604dff9ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040698 Jan 19 16:33:13.672959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 805/1498] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:14.606085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:14.606758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:14.613537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:14.614015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:14.614788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:14.615227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:14.750856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:14.759057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:14.760653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:14.761801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bed49325-cffb-42d9-ab85-23924081cd18 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159470 Jan 19 16:33:14.762358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 806/1499] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:14 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:14.766625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0e68646a-3cb9-4237-be59-ebc2cb5c440d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:14.767523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0e68646a-3cb9-4237-be59-ebc2cb5c440d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:14.773172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e68646a-3cb9-4237-be59-ebc2cb5c440d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:14.773649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e68646a-3cb9-4237-be59-ebc2cb5c440d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:14.774435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e68646a-3cb9-4237-be59-ebc2cb5c440d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:14.774890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e68646a-3cb9-4237-be59-ebc2cb5c440d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:14.804031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0e68646a-3cb9-4237-be59-ebc2cb5c440d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040633 Jan 19 16:33:14.804583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 807/1500] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:14.808806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9c985dd7-caba-42f5-9d09-c4e263e8541f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:14.809698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9c985dd7-caba-42f5-9d09-c4e263e8541f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:14.815666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c985dd7-caba-42f5-9d09-c4e263e8541f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:14.816150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c985dd7-caba-42f5-9d09-c4e263e8541f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:14.816929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c985dd7-caba-42f5-9d09-c4e263e8541f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:14.817375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c985dd7-caba-42f5-9d09-c4e263e8541f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:14.845322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9c985dd7-caba-42f5-9d09-c4e263e8541f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039763 Jan 19 16:33:14.845879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 808/1501] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:15.780431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:15.781125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:15.787822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:15.788279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:15.789072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:15.789511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:15.926374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:15.934724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:15.936205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:15.937337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f9d01a08-56fe-440d-a413-ee76fad13d1f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.160682 Jan 19 16:33:15.937886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 809/1502] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:15 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:15.942154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-72c9ae0a-d8b8-4f8d-a2f4-4560f5e9c90a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:33:15.943114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-72c9ae0a-d8b8-4f8d-a2f4-4560f5e9c90a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:15.951453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72c9ae0a-d8b8-4f8d-a2f4-4560f5e9c90a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:15.951966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72c9ae0a-d8b8-4f8d-a2f4-4560f5e9c90a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:15.953244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72c9ae0a-d8b8-4f8d-a2f4-4560f5e9c90a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:15.954039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72c9ae0a-d8b8-4f8d-a2f4-4560f5e9c90a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:16.041294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-72c9ae0a-d8b8-4f8d-a2f4-4560f5e9c90a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action" status: 200 len: 97225 microversion: 2.1 time: 0.102158 Jan 19 16:33:16.050018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 810/1503] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:33:15 2022] POST /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd/action => generated 97225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:33:16.050018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0f53351e-ac39-4a9c-9725-0ca29548ad9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:16.050018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0f53351e-ac39-4a9c-9725-0ca29548ad9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:16.056454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f53351e-ac39-4a9c-9725-0ca29548ad9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:16.056912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f53351e-ac39-4a9c-9725-0ca29548ad9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:16.057723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f53351e-ac39-4a9c-9725-0ca29548ad9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:16.058169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f53351e-ac39-4a9c-9725-0ca29548ad9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:16.092510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0f53351e-ac39-4a9c-9725-0ca29548ad9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048672 Jan 19 16:33:16.093304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 811/1504] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:16.956058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:16.956719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:16.963037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:16.963496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:16.964320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:16.964767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:17.105756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:17.114292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:17.115869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:17.117031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-723f9e85-3384-47ce-98d5-8a180a159c77 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.165308 Jan 19 16:33:17.117588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 812/1505] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:16 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:17.121994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b9369fcb-7015-412c-93ac-265fc54264f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:17.122952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b9369fcb-7015-412c-93ac-265fc54264f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:17.129464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9369fcb-7015-412c-93ac-265fc54264f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:17.129920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9369fcb-7015-412c-93ac-265fc54264f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:17.130727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9369fcb-7015-412c-93ac-265fc54264f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:17.131166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9369fcb-7015-412c-93ac-265fc54264f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:17.162784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b9369fcb-7015-412c-93ac-265fc54264f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Jan 19 16:33:17.163355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 813/1506] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:18.136267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:18.136961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:18.143946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:18.144396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:18.145182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:18.145615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:18.286158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:18.301090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:18.303862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:18.306047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-14520b6e-2672-4ec7-847d-50b4787fc535 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.173209 Jan 19 16:33:18.307080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 814/1507] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:18 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:18.315657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-95b11bf8-8158-41a2-9b6b-fe15438531e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:18.316930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-95b11bf8-8158-41a2-9b6b-fe15438531e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:18.325065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95b11bf8-8158-41a2-9b6b-fe15438531e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:18.325824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95b11bf8-8158-41a2-9b6b-fe15438531e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:18.327875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95b11bf8-8158-41a2-9b6b-fe15438531e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:18.328635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95b11bf8-8158-41a2-9b6b-fe15438531e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:18.364276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-95b11bf8-8158-41a2-9b6b-fe15438531e0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055729 Jan 19 16:33:18.364856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 815/1508] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:19.325485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:19.326177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:19.332374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:19.332831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:19.333609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:19.334048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:19.460562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:19.469366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:19.470839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:19.472022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c34a647-4d23-43b2-8f9e-21c8f9630ae8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.150199 Jan 19 16:33:19.472608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 816/1509] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:19.476949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4e3f9290-06de-48b2-8476-6d2866b5ed02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:19.477842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4e3f9290-06de-48b2-8476-6d2866b5ed02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:19.483974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e3f9290-06de-48b2-8476-6d2866b5ed02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:19.484429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e3f9290-06de-48b2-8476-6d2866b5ed02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:19.485201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e3f9290-06de-48b2-8476-6d2866b5ed02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:19.485639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e3f9290-06de-48b2-8476-6d2866b5ed02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:19.513313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4e3f9290-06de-48b2-8476-6d2866b5ed02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039713 Jan 19 16:33:19.513866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 817/1510] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:20.490116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:20.490778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:20.497316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:20.497755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:20.499087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:20.499611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:20.631402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:20.639605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:20.641117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:20.642260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3ee1b5a5-8610-41d1-ba02-8351270ef5e1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155851 Jan 19 16:33:20.642806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 818/1511] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:20 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:20.647115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fcadc83b-f7dc-4896-826a-d8bd81d2655c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:20.648073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fcadc83b-f7dc-4896-826a-d8bd81d2655c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:20.653785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcadc83b-f7dc-4896-826a-d8bd81d2655c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:20.654237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcadc83b-f7dc-4896-826a-d8bd81d2655c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:20.655014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcadc83b-f7dc-4896-826a-d8bd81d2655c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:20.655454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fcadc83b-f7dc-4896-826a-d8bd81d2655c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:20.684641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fcadc83b-f7dc-4896-826a-d8bd81d2655c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040830 Jan 19 16:33:20.685203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 819/1512] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:21.660759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:21.661402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:21.667790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:21.668236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:21.669005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:21.669436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:21.797690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:21.805797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:21.807273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:21.808432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d0e3850f-26c2-4e39-a1b8-b3ca29198b46 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.151331 Jan 19 16:33:21.808982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 820/1513] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:21 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:21.813338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-16243acc-8e71-45f9-baed-7378cfd01238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:21.814222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-16243acc-8e71-45f9-baed-7378cfd01238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:21.819594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16243acc-8e71-45f9-baed-7378cfd01238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:21.820066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16243acc-8e71-45f9-baed-7378cfd01238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:21.820829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16243acc-8e71-45f9-baed-7378cfd01238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:21.821261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16243acc-8e71-45f9-baed-7378cfd01238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:21.849213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-16243acc-8e71-45f9-baed-7378cfd01238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039270 Jan 19 16:33:21.849743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 821/1514] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:22.826431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:22.827575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:22.834116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:22.834572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:22.835352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:22.835825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:22.970162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:22.978337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:22.979862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:22.981003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f9af6ed4-dcd5-41ce-9f7e-f344abcdb8cf tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.158370 Jan 19 16:33:22.981558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 822/1515] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:22 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:22.986108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4b6210e-95b0-4edc-849e-7057624d4154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:22.987000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4b6210e-95b0-4edc-849e-7057624d4154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:22.992708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4b6210e-95b0-4edc-849e-7057624d4154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:22.993164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4b6210e-95b0-4edc-849e-7057624d4154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:22.993938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4b6210e-95b0-4edc-849e-7057624d4154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:22.994372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4b6210e-95b0-4edc-849e-7057624d4154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:23.023219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4b6210e-95b0-4edc-849e-7057624d4154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040689 Jan 19 16:33:23.023783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 823/1516] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:24.000559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:24.001214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:24.008347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:24.008792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:24.009574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:24.010013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:24.145981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:24.154284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:24.155844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:24.157319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6bba4c4b-d7c6-4903-af67-3bf8b591948a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.161034 Jan 19 16:33:24.164621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 824/1517] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:23 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:24.164621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-669aca31-76b5-420f-9fb6-dd09c64de083 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:24.164621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-669aca31-76b5-420f-9fb6-dd09c64de083 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:24.169550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-669aca31-76b5-420f-9fb6-dd09c64de083 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:24.169998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-669aca31-76b5-420f-9fb6-dd09c64de083 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:24.170775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-669aca31-76b5-420f-9fb6-dd09c64de083 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:24.171207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-669aca31-76b5-420f-9fb6-dd09c64de083 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:24.206156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-669aca31-76b5-420f-9fb6-dd09c64de083 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Jan 19 16:33:24.206717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 825/1518] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:25.175780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:25.176486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:25.182913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:25.183363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:25.184218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:25.184692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:25.318883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:25.328733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:25.330237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:25.331404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6254a8f4-f9bc-40d2-9f2f-77b6c3c10e87 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159429 Jan 19 16:33:25.331994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 826/1519] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:25 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:25.336376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-516d4e77-00f9-4f73-b946-8c9ab3b68b7f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:25.337277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-516d4e77-00f9-4f73-b946-8c9ab3b68b7f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:25.343350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-516d4e77-00f9-4f73-b946-8c9ab3b68b7f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:25.344430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-516d4e77-00f9-4f73-b946-8c9ab3b68b7f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:25.345266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-516d4e77-00f9-4f73-b946-8c9ab3b68b7f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:25.345664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-516d4e77-00f9-4f73-b946-8c9ab3b68b7f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:25.375197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-516d4e77-00f9-4f73-b946-8c9ab3b68b7f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 Jan 19 16:33:25.375999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 827/1520] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:26.349669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:26.350347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:26.356578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:26.357033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:26.357821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:26.358249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:26.494193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:26.503147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:26.504699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:26.505861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5abc4cb0-fc60-46c0-a240-b46037501c1d tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.159920 Jan 19 16:33:26.506413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 828/1521] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:26 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:26.510800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c0cac859-4dfe-4cf5-bc67-491875a21e8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:26.511737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c0cac859-4dfe-4cf5-bc67-491875a21e8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:26.518411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0cac859-4dfe-4cf5-bc67-491875a21e8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:26.518864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0cac859-4dfe-4cf5-bc67-491875a21e8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:26.519661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0cac859-4dfe-4cf5-bc67-491875a21e8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:26.520134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0cac859-4dfe-4cf5-bc67-491875a21e8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:26.550518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c0cac859-4dfe-4cf5-bc67-491875a21e8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043064 Jan 19 16:33:26.551086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 829/1522] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:27.524208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:27.524886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:27.531488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:27.531998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:27.532781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:27.533223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:27.666310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:27.675004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:27.676536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:27.677686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8d5b07a9-5673-4e84-b727-3de7a20a9c31 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157213 Jan 19 16:33:27.678246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 830/1523] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:27 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:27.682704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d8cf8848-dce8-496f-b7b7-5b123fbac09d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:27.684020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d8cf8848-dce8-496f-b7b7-5b123fbac09d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:27.689624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8cf8848-dce8-496f-b7b7-5b123fbac09d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:27.690081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8cf8848-dce8-496f-b7b7-5b123fbac09d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:27.690874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8cf8848-dce8-496f-b7b7-5b123fbac09d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:27.691318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8cf8848-dce8-496f-b7b7-5b123fbac09d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:27.719910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d8cf8848-dce8-496f-b7b7-5b123fbac09d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040655 Jan 19 16:33:27.720461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 831/1524] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:28.696868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:28.697575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:28.704323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:28.704764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:28.705531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:28.705961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:28.839719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:28.848475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:28.849962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:28.851091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3749436f-8945-4a65-afcc-8422ea0e64f2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.157915 Jan 19 16:33:28.851643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 832/1525] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:28 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:28.855915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-796d235b-9971-4470-a186-bdae1814d596 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:28.856812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-796d235b-9971-4470-a186-bdae1814d596 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:28.862596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-796d235b-9971-4470-a186-bdae1814d596 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:28.863049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-796d235b-9971-4470-a186-bdae1814d596 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:28.863881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-796d235b-9971-4470-a186-bdae1814d596 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:28.864326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-796d235b-9971-4470-a186-bdae1814d596 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:28.898164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-796d235b-9971-4470-a186-bdae1814d596 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 Jan 19 16:33:28.898733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 833/1526] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:29.869792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:29.870483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:29.877837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:29.878288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:29.879080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:29.879515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:30.009975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:30.018297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:30.019822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:33:30.020972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9207c35a-292d-4fa4-9ebf-af4db47d841b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 200 len: 1753 microversion: 2.20 time: 0.155082 Jan 19 16:33:30.021528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 834/1527] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:33:29 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:33:30.025799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c001528e-6812-4c93-8f1e-d4b01a0bc180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:30.026699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c001528e-6812-4c93-8f1e-d4b01a0bc180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:30.032975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c001528e-6812-4c93-8f1e-d4b01a0bc180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:30.033436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c001528e-6812-4c93-8f1e-d4b01a0bc180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:30.034228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c001528e-6812-4c93-8f1e-d4b01a0bc180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:30.034666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c001528e-6812-4c93-8f1e-d4b01a0bc180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:30.064354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c001528e-6812-4c93-8f1e-d4b01a0bc180 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Jan 19 16:33:30.064924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 835/1528] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:31.075929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dcdf3244-3f6b-447f-9e21-01d6b1af0fc7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:31.076842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dcdf3244-3f6b-447f-9e21-01d6b1af0fc7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:31.083204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcdf3244-3f6b-447f-9e21-01d6b1af0fc7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:31.083659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcdf3244-3f6b-447f-9e21-01d6b1af0fc7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:31.084479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcdf3244-3f6b-447f-9e21-01d6b1af0fc7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:31.084924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcdf3244-3f6b-447f-9e21-01d6b1af0fc7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:31.115530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dcdf3244-3f6b-447f-9e21-01d6b1af0fc7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 Jan 19 16:33:31.116139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 836/1529] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:32.126045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-afd2e809-efb4-4f09-a098-aa9a730b6a7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:32.126949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-afd2e809-efb4-4f09-a098-aa9a730b6a7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:32.133392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afd2e809-efb4-4f09-a098-aa9a730b6a7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:32.133835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afd2e809-efb4-4f09-a098-aa9a730b6a7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:32.134605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afd2e809-efb4-4f09-a098-aa9a730b6a7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:32.135037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afd2e809-efb4-4f09-a098-aa9a730b6a7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:32.165278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-afd2e809-efb4-4f09-a098-aa9a730b6a7b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Jan 19 16:33:32.165836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 837/1530] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:33.177633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0171a02f-fee7-4bc0-a115-49336b007dd5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:33.178539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0171a02f-fee7-4bc0-a115-49336b007dd5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:33.184826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0171a02f-fee7-4bc0-a115-49336b007dd5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:33.185267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0171a02f-fee7-4bc0-a115-49336b007dd5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:33.186034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0171a02f-fee7-4bc0-a115-49336b007dd5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:33.186467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0171a02f-fee7-4bc0-a115-49336b007dd5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:33.214476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0171a02f-fee7-4bc0-a115-49336b007dd5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Jan 19 16:33:33.215023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 838/1531] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:33:34.225917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f242a343-2455-41ff-a7d1-a0e4e0ea0e43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:34.226906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f242a343-2455-41ff-a7d1-a0e4e0ea0e43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:34.233570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f242a343-2455-41ff-a7d1-a0e4e0ea0e43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:34.234024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f242a343-2455-41ff-a7d1-a0e4e0ea0e43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:34.235305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f242a343-2455-41ff-a7d1-a0e4e0ea0e43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:34.235781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f242a343-2455-41ff-a7d1-a0e4e0ea0e43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:34.264718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f242a343-2455-41ff-a7d1-a0e4e0ea0e43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 Jan 19 16:33:34.265284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 839/1532] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:35.276158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7e0ea56e-b1a3-47c4-a655-d0760446b834 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:35.277083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7e0ea56e-b1a3-47c4-a655-d0760446b834 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:35.283774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e0ea56e-b1a3-47c4-a655-d0760446b834 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:35.284237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e0ea56e-b1a3-47c4-a655-d0760446b834 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:35.285034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e0ea56e-b1a3-47c4-a655-d0760446b834 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:35.285479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e0ea56e-b1a3-47c4-a655-d0760446b834 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:35.316039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7e0ea56e-b1a3-47c4-a655-d0760446b834 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Jan 19 16:33:35.316612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 840/1533] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:36.327492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4ea7d86-0a48-4f8b-a7c0-ba68895b90ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:36.328919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4ea7d86-0a48-4f8b-a7c0-ba68895b90ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:36.335290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ea7d86-0a48-4f8b-a7c0-ba68895b90ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:36.335766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ea7d86-0a48-4f8b-a7c0-ba68895b90ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:36.336550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ea7d86-0a48-4f8b-a7c0-ba68895b90ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:36.336982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4ea7d86-0a48-4f8b-a7c0-ba68895b90ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:36.366695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4ea7d86-0a48-4f8b-a7c0-ba68895b90ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Jan 19 16:33:36.367282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 841/1534] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:37.379188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-23baf3b8-a498-4a6d-8eff-2dda12063441 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:37.380138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-23baf3b8-a498-4a6d-8eff-2dda12063441 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:37.387027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23baf3b8-a498-4a6d-8eff-2dda12063441 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:37.387027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23baf3b8-a498-4a6d-8eff-2dda12063441 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:37.388220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23baf3b8-a498-4a6d-8eff-2dda12063441 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:37.388657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23baf3b8-a498-4a6d-8eff-2dda12063441 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:37.419223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-23baf3b8-a498-4a6d-8eff-2dda12063441 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Jan 19 16:33:37.419810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 842/1535] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:38.431072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ade041c4-4c9f-4958-a5fe-5fcb485f7f00 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:38.432041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ade041c4-4c9f-4958-a5fe-5fcb485f7f00 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:38.438393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade041c4-4c9f-4958-a5fe-5fcb485f7f00 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:38.438852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade041c4-4c9f-4958-a5fe-5fcb485f7f00 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:38.439640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade041c4-4c9f-4958-a5fe-5fcb485f7f00 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:38.440123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade041c4-4c9f-4958-a5fe-5fcb485f7f00 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:38.469119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ade041c4-4c9f-4958-a5fe-5fcb485f7f00 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041294 Jan 19 16:33:38.469681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 843/1536] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:39.480675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b9f18d68-fab8-41b4-8123-6dd2ed152580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:39.481577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b9f18d68-fab8-41b4-8123-6dd2ed152580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:39.488488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f18d68-fab8-41b4-8123-6dd2ed152580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:39.488942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f18d68-fab8-41b4-8123-6dd2ed152580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:39.489732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f18d68-fab8-41b4-8123-6dd2ed152580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:39.490204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9f18d68-fab8-41b4-8123-6dd2ed152580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:39.520431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b9f18d68-fab8-41b4-8123-6dd2ed152580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Jan 19 16:33:39.521001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 844/1537] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:40.532241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9c20703f-bca2-4bd6-b627-a0c7d294248b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:40.533155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9c20703f-bca2-4bd6-b627-a0c7d294248b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:40.539597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c20703f-bca2-4bd6-b627-a0c7d294248b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:40.540079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c20703f-bca2-4bd6-b627-a0c7d294248b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:40.541227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c20703f-bca2-4bd6-b627-a0c7d294248b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:40.541677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c20703f-bca2-4bd6-b627-a0c7d294248b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:40.571801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9c20703f-bca2-4bd6-b627-a0c7d294248b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Jan 19 16:33:40.572379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 845/1538] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:41.582714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-68d45a09-bdf5-4d5a-85a2-2d3c1e68fd01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:41.583721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-68d45a09-bdf5-4d5a-85a2-2d3c1e68fd01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:41.590301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68d45a09-bdf5-4d5a-85a2-2d3c1e68fd01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:41.590759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68d45a09-bdf5-4d5a-85a2-2d3c1e68fd01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:41.591556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68d45a09-bdf5-4d5a-85a2-2d3c1e68fd01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:41.592022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68d45a09-bdf5-4d5a-85a2-2d3c1e68fd01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:41.622451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-68d45a09-bdf5-4d5a-85a2-2d3c1e68fd01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Jan 19 16:33:41.623013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 846/1539] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:42.634319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-51c9e897-f0e1-4a01-9cfb-a5dd46db19bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:42.635198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-51c9e897-f0e1-4a01-9cfb-a5dd46db19bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:42.642104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51c9e897-f0e1-4a01-9cfb-a5dd46db19bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:42.642554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51c9e897-f0e1-4a01-9cfb-a5dd46db19bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:42.643387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51c9e897-f0e1-4a01-9cfb-a5dd46db19bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:42.643864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51c9e897-f0e1-4a01-9cfb-a5dd46db19bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:42.675705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-51c9e897-f0e1-4a01-9cfb-a5dd46db19bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Jan 19 16:33:42.676397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 847/1540] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:43.688811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1592c3a0-7ee6-4f9c-b927-4bbd0b6b0c6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:43.689721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1592c3a0-7ee6-4f9c-b927-4bbd0b6b0c6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:43.696235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1592c3a0-7ee6-4f9c-b927-4bbd0b6b0c6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:43.696713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1592c3a0-7ee6-4f9c-b927-4bbd0b6b0c6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:43.697501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1592c3a0-7ee6-4f9c-b927-4bbd0b6b0c6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:43.697938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1592c3a0-7ee6-4f9c-b927-4bbd0b6b0c6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:43.726969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1592c3a0-7ee6-4f9c-b927-4bbd0b6b0c6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041917 Jan 19 16:33:43.727527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 848/1541] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:44.738674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c54792a0-20ec-4d02-92aa-bc23d3456b42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:44.739647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c54792a0-20ec-4d02-92aa-bc23d3456b42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:44.745908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c54792a0-20ec-4d02-92aa-bc23d3456b42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:44.746367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c54792a0-20ec-4d02-92aa-bc23d3456b42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:44.747440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c54792a0-20ec-4d02-92aa-bc23d3456b42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:44.747921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c54792a0-20ec-4d02-92aa-bc23d3456b42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:44.777813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c54792a0-20ec-4d02-92aa-bc23d3456b42 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Jan 19 16:33:44.778545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 849/1542] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:45.790393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-24d5e9e6-7c02-4f58-91d7-9e52d440b76e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:45.791297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-24d5e9e6-7c02-4f58-91d7-9e52d440b76e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:45.798180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24d5e9e6-7c02-4f58-91d7-9e52d440b76e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:45.798639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24d5e9e6-7c02-4f58-91d7-9e52d440b76e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:45.799409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24d5e9e6-7c02-4f58-91d7-9e52d440b76e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:45.799881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24d5e9e6-7c02-4f58-91d7-9e52d440b76e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:45.828047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-24d5e9e6-7c02-4f58-91d7-9e52d440b76e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Jan 19 16:33:45.828656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 850/1543] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:46.839793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a51a63fe-0572-41ad-b1cc-ea20603fdc09 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:46.840708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a51a63fe-0572-41ad-b1cc-ea20603fdc09 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:46.847240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a51a63fe-0572-41ad-b1cc-ea20603fdc09 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:46.847711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a51a63fe-0572-41ad-b1cc-ea20603fdc09 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:46.848518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a51a63fe-0572-41ad-b1cc-ea20603fdc09 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:46.848962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a51a63fe-0572-41ad-b1cc-ea20603fdc09 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:46.880819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a51a63fe-0572-41ad-b1cc-ea20603fdc09 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Jan 19 16:33:46.881393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 851/1544] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:47.892317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-12f6f1a0-6874-49fe-beb5-29d01986a86e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:47.893214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-12f6f1a0-6874-49fe-beb5-29d01986a86e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:47.899440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12f6f1a0-6874-49fe-beb5-29d01986a86e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:47.899944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12f6f1a0-6874-49fe-beb5-29d01986a86e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:47.900717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12f6f1a0-6874-49fe-beb5-29d01986a86e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:47.901149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12f6f1a0-6874-49fe-beb5-29d01986a86e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:47.930611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-12f6f1a0-6874-49fe-beb5-29d01986a86e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042022 Jan 19 16:33:47.931174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 852/1545] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:48.941986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d4f5fe48-4ea5-4408-b865-c046049e6fa7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:48.942822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d4f5fe48-4ea5-4408-b865-c046049e6fa7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:48.949119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4f5fe48-4ea5-4408-b865-c046049e6fa7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:48.949577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4f5fe48-4ea5-4408-b865-c046049e6fa7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:48.950360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4f5fe48-4ea5-4408-b865-c046049e6fa7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:48.950804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4f5fe48-4ea5-4408-b865-c046049e6fa7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:48.979163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d4f5fe48-4ea5-4408-b865-c046049e6fa7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Jan 19 16:33:48.979729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 853/1546] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:49.990952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e271d190-79e9-4a95-bf08-40bf71b33dd8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:49.991907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e271d190-79e9-4a95-bf08-40bf71b33dd8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:49.998443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e271d190-79e9-4a95-bf08-40bf71b33dd8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:49.998893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e271d190-79e9-4a95-bf08-40bf71b33dd8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:49.999665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e271d190-79e9-4a95-bf08-40bf71b33dd8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:50.000117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e271d190-79e9-4a95-bf08-40bf71b33dd8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:50.028940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e271d190-79e9-4a95-bf08-40bf71b33dd8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Jan 19 16:33:50.029483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 854/1547] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:51.041242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8fc76943-aac5-4e45-b6c6-1988651e5245 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:51.042145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8fc76943-aac5-4e45-b6c6-1988651e5245 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:51.048207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fc76943-aac5-4e45-b6c6-1988651e5245 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:51.048654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fc76943-aac5-4e45-b6c6-1988651e5245 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:51.049415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fc76943-aac5-4e45-b6c6-1988651e5245 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:51.049845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fc76943-aac5-4e45-b6c6-1988651e5245 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:51.078840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8fc76943-aac5-4e45-b6c6-1988651e5245 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041356 Jan 19 16:33:51.080062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 855/1548] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:52.090650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-386ed023-ee6e-4d62-b9ab-8d2ef9fe6624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:52.091612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-386ed023-ee6e-4d62-b9ab-8d2ef9fe6624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:52.099063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-386ed023-ee6e-4d62-b9ab-8d2ef9fe6624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:52.099519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-386ed023-ee6e-4d62-b9ab-8d2ef9fe6624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:52.100351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-386ed023-ee6e-4d62-b9ab-8d2ef9fe6624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:52.100791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-386ed023-ee6e-4d62-b9ab-8d2ef9fe6624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:52.132511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-386ed023-ee6e-4d62-b9ab-8d2ef9fe6624 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Jan 19 16:33:52.133099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 856/1549] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:53.144046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4671337e-fed9-460a-8ce5-035f4d5bea27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:53.144960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4671337e-fed9-460a-8ce5-035f4d5bea27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:53.151172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4671337e-fed9-460a-8ce5-035f4d5bea27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:53.151626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4671337e-fed9-460a-8ce5-035f4d5bea27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:53.152439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4671337e-fed9-460a-8ce5-035f4d5bea27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:53.152881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4671337e-fed9-460a-8ce5-035f4d5bea27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:53.183174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4671337e-fed9-460a-8ce5-035f4d5bea27 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 Jan 19 16:33:53.183753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 857/1550] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:54.195012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9a025a61-a8d9-49ee-b2c5-52d37c243e8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:54.196135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9a025a61-a8d9-49ee-b2c5-52d37c243e8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:54.202432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a025a61-a8d9-49ee-b2c5-52d37c243e8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:54.202890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a025a61-a8d9-49ee-b2c5-52d37c243e8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:54.204338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a025a61-a8d9-49ee-b2c5-52d37c243e8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:54.204788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a025a61-a8d9-49ee-b2c5-52d37c243e8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:54.234001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9a025a61-a8d9-49ee-b2c5-52d37c243e8e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Jan 19 16:33:54.234562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 858/1551] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:55.246277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d2930347-eeac-4eea-bd39-60be1642ad98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:55.247215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d2930347-eeac-4eea-bd39-60be1642ad98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:55.254374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2930347-eeac-4eea-bd39-60be1642ad98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:55.254831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2930347-eeac-4eea-bd39-60be1642ad98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:55.255614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2930347-eeac-4eea-bd39-60be1642ad98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:55.256089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2930347-eeac-4eea-bd39-60be1642ad98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:55.284272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d2930347-eeac-4eea-bd39-60be1642ad98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Jan 19 16:33:55.284836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 859/1552] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:56.295611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b67167f4-f11e-44f6-938c-0d5495af84ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:56.296571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b67167f4-f11e-44f6-938c-0d5495af84ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:56.303325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67167f4-f11e-44f6-938c-0d5495af84ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:56.303813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67167f4-f11e-44f6-938c-0d5495af84ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:56.304582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67167f4-f11e-44f6-938c-0d5495af84ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:56.305013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b67167f4-f11e-44f6-938c-0d5495af84ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:56.332755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b67167f4-f11e-44f6-938c-0d5495af84ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040846 Jan 19 16:33:56.333302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 860/1553] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:33:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:33:56.823590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:33:56.824417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:33:56.831428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:56.832184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:33:56.833522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:33:56.834171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:34:10.622506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid eda15853-ef18-40f3-9063-9e714ebd9a12 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:34:41.365979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:34:41.367166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:34:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 (ip 10.222.0.42) !!! Jan 19 16:35:57.137669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f00fb7da-9310-4b5b-b741-d90a61521e1b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4" status: 202 len: 0 microversion: 2.1 time: 120.317547 Jan 19 16:35:57.138415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 861/1554] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:33:56 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 => generated 0 bytes in 120321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:35:57.225252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:35:57.225876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:35:57.234143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:35:57.234890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:35:57.235924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:35:57.236368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:36:06.101408 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:36:06.102077 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:36:08.374477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:36:08.375073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 (ip 10.222.0.42) !!! Jan 19 16:36:10.774051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Cannot 'detach_volume' instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 while it is in task_state spawning Jan 19 16:36:10.774629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 409 to user: Cannot 'detach_volume' instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 while it is in task_state spawning {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:36:10.775451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0edf0774-61f0-48e7-b1bb-884dbe836b04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533" status: 409 len: 155 microversion: 2.20 time: 13.635829 Jan 19 16:36:10.776034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 862/1555] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jan 19 16:35:57 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 => generated 155 bytes in 13637 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Jan 19 16:36:10.852665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79a03ec2-c737-4702-9514-6ede1fff0b80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:36:10.852665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79a03ec2-c737-4702-9514-6ede1fff0b80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:36:10.857509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79a03ec2-c737-4702-9514-6ede1fff0b80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:36:10.857955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79a03ec2-c737-4702-9514-6ede1fff0b80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:36:10.858744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79a03ec2-c737-4702-9514-6ede1fff0b80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:36:10.859177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79a03ec2-c737-4702-9514-6ede1fff0b80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:36:10.889794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79a03ec2-c737-4702-9514-6ede1fff0b80 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112631 Jan 19 16:36:10.890394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 863/1556] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:36:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:36:10.894636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4e51527d-8496-49fd-8add-3e7f5fb4d3ab tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Calling method '.version_select at 0x7f716c17ca60>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:36:10.915176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4e51527d-8496-49fd-8add-3e7f5fb4d3ab tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102" status: 202 len: 0 microversion: 2.1 time: 0.023694 Jan 19 16:36:10.915745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 864/1557] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:36:10.920032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:36:10.920622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:36:10.926004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:36:10.926445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:36:10.927211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:36:10.927641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:36:10.988649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:36:10.995864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-049ac54f-68c3-4f19-9cab-67c913a2111a tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.079055 Jan 19 16:36:10.996416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 865/1558] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:36:10 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:36:11.001251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:36:11.001733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:36:11.007098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:36:11.007544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:36:11.008341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:36:11.008782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:36:32.045135 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:36:32.045673 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:36:32.534868 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:36:32.535027 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:37:57.571203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid eda15853-ef18-40f3-9063-9e714ebd9a12 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:38:09.975650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:38:09.976421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 (ip 10.222.0.42) !!! Jan 19 16:38:10.907528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-924629ad-df06-4545-9481-ae9dcf46148d) Jan 19 16:38:10.908163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-924629ad-df06-4545-9481-ae9dcf46148d) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:38:10.908997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ab19fc64-c63a-438e-b1bd-30b683628899 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4" status: 400 len: 269 microversion: 2.1 time: 119.911095 Jan 19 16:38:10.909651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 866/1559] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:36:10 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 => generated 269 bytes in 119913 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:38:10.915037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:38:10.915526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:38:10.922924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:38:10.923375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:38:10.924204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:38:10.924642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:39:26.111542 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:39:26.112746 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:39:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:39:28.382851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:39:28.383421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 (ip 10.222.0.42) !!! Jan 19 16:39:52.052973 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:39:52.053595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:39:52.542849 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:39:52.543110 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:39:57.851453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Cannot 'detach_volume' instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 while it is in task_state spawning Jan 19 16:39:57.852175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 409 to user: Cannot 'detach_volume' instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 while it is in task_state spawning {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:39:57.853001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533" status: 409 len: 155 microversion: 2.20 time: 106.942547 Jan 19 16:39:57.853505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:39:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 (ip 10.222.0.42) !!! Jan 19 16:39:57.853930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:39:57 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 (10.222.0.42) Jan 19 16:39:57.854735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: CRITICAL nova [None req-be588774-3b41-4b46-9209-ee92e2ee90b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Unhandled error: OSError: write error Jan 19 16:39:57.854735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR nova OSError: write error Jan 19 16:39:57.854735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR nova Jan 19 16:39:57.854977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 867/1560] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jan 19 16:38:10 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 => generated 0 bytes in 106945 msecs (HTTP/1.1 409) 9 headers in 0 bytes (0 switches on core 0) Jan 19 16:39:57.860607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:39:57.861404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:39:57.869745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:39:57.870174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:39:57.871122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:39:57.871550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:39:57.902903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Jan 19 16:39:57.903417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:39:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments (ip 10.222.0.42) !!! Jan 19 16:39:57.903417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:39:57 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments (10.222.0.42) Jan 19 16:39:57.904020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: CRITICAL nova [None req-52842529-55d5-4d4a-8c24-485d46505f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Unhandled error: OSError: write error Jan 19 16:39:57.904020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR nova OSError: write error Jan 19 16:39:57.904020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR nova Jan 19 16:39:57.904291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 868/1561] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:39:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jan 19 16:39:58.137972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2c75c8e0-67a6-4235-ad1d-ba4fff0c61c0 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Calling method '.version_select at 0x7f716c1c1dc0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:39:58.154258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-2c75c8e0-67a6-4235-ad1d-ba4fff0c61c0 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 Jan 19 16:39:58.155164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2c75c8e0-67a6-4235-ad1d-ba4fff0c61c0 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Returning 404 to user: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:39:58.156113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2c75c8e0-67a6-4235-ad1d-ba4fff0c61c0 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102" status: 404 len: 142 microversion: 2.1 time: 0.251058 Jan 19 16:39:58.156737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 869/1562] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:39:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102 => generated 142 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:39:58.161303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:39:58.161914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:39:58.168957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:39:58.169411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:39:58.170209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:39:58.170654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:39:58.230405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7616da9db584316b3a8ad4bb1ede6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27fc0bc850044ad690c3db4879b19c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:39:58.239379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-684de8fe-ffd2-4566-919a-aca2b65d9805 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 200 len: 1225 microversion: 2.1 time: 0.081412 Jan 19 16:39:58.240014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 870/1563] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:39:58 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:39:58.245187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:39:58.245685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:39:58.251430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:39:58.252470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:39:58.253265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:39:58.254326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:39:58.341190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid eda15853-ef18-40f3-9063-9e714ebd9a12 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:40:11.149528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4da8168f-8ccd-450e-a37d-074d7f5443af) Jan 19 16:40:11.150265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4da8168f-8ccd-450e-a37d-074d7f5443af) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:11.151010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-485a3c0e-5eca-48b6-90ab-2c10038cff7f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4" status: 400 len: 269 microversion: 2.1 time: 12.909876 Jan 19 16:40:11.151956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 871/1564] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:39:58 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 => generated 269 bytes in 12911 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:11.156550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a87084f7-7fed-4258-9086-17445d9d2dde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:11.157561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a87084f7-7fed-4258-9086-17445d9d2dde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:11.164981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87084f7-7fed-4258-9086-17445d9d2dde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.165424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87084f7-7fed-4258-9086-17445d9d2dde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.166212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87084f7-7fed-4258-9086-17445d9d2dde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.166649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87084f7-7fed-4258-9086-17445d9d2dde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.421891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a87084f7-7fed-4258-9086-17445d9d2dde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533" status: 202 len: 0 microversion: 2.20 time: 0.268719 Jan 19 16:40:11.422391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 872/1565] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jan 19 16:40:11 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:40:11.548335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:11.548828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:11.558405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.558889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.560468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.561005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.585654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:40:11.674996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79783293-b1db-4146-ab4a-4c5ff1c23ce1 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 204 len: 0 microversion: 2.1 time: 0.251278 Jan 19 16:40:11.675498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 873/1566] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:40:11 2022] DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:40:11.681199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-522d15fe-4ba2-4106-99c7-85269320f17e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:11.682251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-522d15fe-4ba2-4106-99c7-85269320f17e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:11.688218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522d15fe-4ba2-4106-99c7-85269320f17e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.688656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522d15fe-4ba2-4106-99c7-85269320f17e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.689434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522d15fe-4ba2-4106-99c7-85269320f17e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.689868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522d15fe-4ba2-4106-99c7-85269320f17e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.719586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-522d15fe-4ba2-4106-99c7-85269320f17e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Jan 19 16:40:11.720167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 874/1567] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:40:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:11.724848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7c70fe5a-e3f0-4e39-9e77-f5fd9e5d9191 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Calling method '.version_select at 0x7f716c18ad30>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:11.735301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-7c70fe5a-e3f0-4e39-9e77-f5fd9e5d9191 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 Jan 19 16:40:11.735915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7c70fe5a-e3f0-4e39-9e77-f5fd9e5d9191 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Returning 404 to user: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:11.736750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7c70fe5a-e3f0-4e39-9e77-f5fd9e5d9191 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102" status: 404 len: 142 microversion: 2.1 time: 0.015705 Jan 19 16:40:11.737282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 875/1568] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:40:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102 => generated 142 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:11.741526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:11.742119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:11.749497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.750008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.750902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.751370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.765667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. Jan 19 16:40:11.766393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 404 to user: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:11.767325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c20f9945-f98b-4022-9700-f76da5cb5c9d tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 404 len: 111 microversion: 2.1 time: 0.029160 Jan 19 16:40:11.767892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 876/1569] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:11 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:11.772766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:11.773252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:11.778923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.779352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.780138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.780570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.866690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid eda15853-ef18-40f3-9063-9e714ebd9a12 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:40:11.921533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ab1a7e3b-079a-42e6-8193-759b6b1d78a1) Jan 19 16:40:11.922136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ab1a7e3b-079a-42e6-8193-759b6b1d78a1) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:11.922969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-abd6849e-40ff-4dbf-b355-3f8c8d7cf39f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4" status: 400 len: 269 microversion: 2.1 time: 0.154183 Jan 19 16:40:11.923520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 877/1570] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:40:11 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 => generated 269 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:11.928025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:11.928453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:11.934301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.934743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:11.935515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:11.935984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.009095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 Jan 19 16:40:12.009702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.010562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4fd58fa3-a992-4dba-b459-dfd195b9e0c4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533" status: 404 len: 154 microversion: 2.20 time: 0.086082 Jan 19 16:40:12.011116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 878/1571] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jan 19 16:40:11 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:12.015472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.016009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.022070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.022525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.023305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.023784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.048325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:40:12.092707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.compute.api [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Instance is already in deleting state, ignoring this request Jan 19 16:40:12.093633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d0765223-40ff-4f03-bb47-3786be4e0b38 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 204 len: 0 microversion: 2.1 time: 0.081582 Jan 19 16:40:12.094214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 879/1572] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:40:12.098752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4de898a-3c69-4aa8-883e-9aa938d5fc76 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.099737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4de898a-3c69-4aa8-883e-9aa938d5fc76 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.105468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de898a-3c69-4aa8-883e-9aa938d5fc76 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.105964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de898a-3c69-4aa8-883e-9aa938d5fc76 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.106744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de898a-3c69-4aa8-883e-9aa938d5fc76 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.107188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de898a-3c69-4aa8-883e-9aa938d5fc76 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.136316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4de898a-3c69-4aa8-883e-9aa938d5fc76 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Jan 19 16:40:12.136924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 880/1573] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:40:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:12.141247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-16f2e14d-9bb1-4e8b-82de-6e285afe7773 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Calling method '.version_select at 0x7f716c04e040>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.152508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-16f2e14d-9bb1-4e8b-82de-6e285afe7773 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 Jan 19 16:40:12.153178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-16f2e14d-9bb1-4e8b-82de-6e285afe7773 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Returning 404 to user: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.153914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-16f2e14d-9bb1-4e8b-82de-6e285afe7773 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102" status: 404 len: 142 microversion: 2.1 time: 0.015958 Jan 19 16:40:12.154688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 881/1574] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102 => generated 142 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:12.158771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.159368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.166256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.166706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.167478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.168413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.181369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. Jan 19 16:40:12.181870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 404 to user: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.182688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-302bf051-f177-4354-906a-ffe365c81485 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 404 len: 111 microversion: 2.1 time: 0.027228 Jan 19 16:40:12.183235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 882/1575] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:12 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:12.187759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.188247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.194605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.195052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.195849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.196278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.277606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid eda15853-ef18-40f3-9063-9e714ebd9a12 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:40:12.345499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad54d828-3d8c-46bc-bd93-0fb8cf039c79) Jan 19 16:40:12.346111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ad54d828-3d8c-46bc-bd93-0fb8cf039c79) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.347303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ad9bfb06-fbf1-42c0-bb5e-032de4ee0a11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4" status: 400 len: 269 microversion: 2.1 time: 0.162657 Jan 19 16:40:12.348211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 883/1576] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 => generated 269 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:12.352497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.352988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.358765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.359223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.360049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.360496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.440426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 Jan 19 16:40:12.440961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.442462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4dce1f11-ec34-4488-b6c0-f490a88ffbf3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533" status: 404 len: 154 microversion: 2.20 time: 0.092966 Jan 19 16:40:12.443028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 884/1577] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:12.447311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.447839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.453764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.454224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.455077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.455524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.481571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:40:12.537443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.compute.api [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Instance is already in deleting state, ignoring this request Jan 19 16:40:12.538533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ffff0fc-30ce-46cd-967e-0768a47288bd tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 204 len: 0 microversion: 2.1 time: 0.094599 Jan 19 16:40:12.539159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 885/1578] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:40:12.544456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ad3d4b8c-3060-44c5-84a9-df962e7f97e7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.545367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ad3d4b8c-3060-44c5-84a9-df962e7f97e7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.551635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad3d4b8c-3060-44c5-84a9-df962e7f97e7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.552175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad3d4b8c-3060-44c5-84a9-df962e7f97e7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.553138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad3d4b8c-3060-44c5-84a9-df962e7f97e7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.553572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad3d4b8c-3060-44c5-84a9-df962e7f97e7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.584007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ad3d4b8c-3060-44c5-84a9-df962e7f97e7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Jan 19 16:40:12.584572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 886/1579] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:40:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:12.588857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a2e2c41f-118e-4a79-8fcd-11ceb12be278 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Calling method '.version_select at 0x7f7166f8d8b0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.599545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-a2e2c41f-118e-4a79-8fcd-11ceb12be278 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 Jan 19 16:40:12.600202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a2e2c41f-118e-4a79-8fcd-11ceb12be278 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Returning 404 to user: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.601010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a2e2c41f-118e-4a79-8fcd-11ceb12be278 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102" status: 404 len: 142 microversion: 2.1 time: 0.015549 Jan 19 16:40:12.601548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 887/1580] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102 => generated 142 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:12.605688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.606283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.614902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.615350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.616150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.616581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.630026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. Jan 19 16:40:12.630759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 404 to user: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.631581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79dfd86c-a1e4-474e-b0a7-1de7c5ae7d03 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 404 len: 111 microversion: 2.1 time: 0.029167 Jan 19 16:40:12.632159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 888/1581] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:12 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:12.636491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.636967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.642629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.643141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.643934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.644439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.729428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid eda15853-ef18-40f3-9063-9e714ebd9a12 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:40:12.782425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48bd7ed9-fe4b-42f3-8dbf-6ec64be7789f) Jan 19 16:40:12.783054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-48bd7ed9-fe4b-42f3-8dbf-6ec64be7789f) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.783914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3b597616-8c94-4c0f-8450-18b2af20c1c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4" status: 400 len: 269 microversion: 2.1 time: 0.150839 Jan 19 16:40:12.784483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 889/1582] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 => generated 269 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:12.789459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.789947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.796316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.796765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.797549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.797979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.873474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 Jan 19 16:40:12.874077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:12.874940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-59be0e40-cca7-4c11-b193-04ecf5a1ac9b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533" status: 404 len: 154 microversion: 2.20 time: 0.089455 Jan 19 16:40:12.875494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 890/1583] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:12.879732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:12.880231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:12.885686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.886139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.886920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:12.887361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:12.911747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:40:12.993164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d45c3616-a6e7-4825-bf6e-9b08e6af1d48 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 204 len: 0 microversion: 2.1 time: 0.116414 Jan 19 16:40:12.993761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 891/1584] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:40:12 2022] DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:40:13.000312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b2ca7058-2832-4ba9-919d-9fc80cc28cff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.001315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b2ca7058-2832-4ba9-919d-9fc80cc28cff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.007019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ca7058-2832-4ba9-919d-9fc80cc28cff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.007473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ca7058-2832-4ba9-919d-9fc80cc28cff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.008290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ca7058-2832-4ba9-919d-9fc80cc28cff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.008737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ca7058-2832-4ba9-919d-9fc80cc28cff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.041847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b2ca7058-2832-4ba9-919d-9fc80cc28cff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Jan 19 16:40:13.042395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 892/1585] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:40:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:13.047126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b5f1171a-c3b0-4a1f-8060-026fc79b469b tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Calling method '.version_select at 0x7f716cd3f9d0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.060180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-b5f1171a-c3b0-4a1f-8060-026fc79b469b tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 Jan 19 16:40:13.060779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b5f1171a-c3b0-4a1f-8060-026fc79b469b tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Returning 404 to user: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.061777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b5f1171a-c3b0-4a1f-8060-026fc79b469b tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102" status: 404 len: 142 microversion: 2.1 time: 0.018483 Jan 19 16:40:13.062528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 893/1586] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102 => generated 142 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:13.066514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.067664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.075845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.076381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.077557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.078008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.092917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. Jan 19 16:40:13.093512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 404 to user: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.094343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9e02ae84-0c12-414d-9dc4-e5723eb79c99 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 404 len: 111 microversion: 2.1 time: 0.031161 Jan 19 16:40:13.094898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 894/1587] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:13 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:13.100031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.100530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.106300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.106751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.107534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.108005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.187756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid eda15853-ef18-40f3-9063-9e714ebd9a12 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:40:13.242593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-605f81fa-877d-40ac-bc9d-d1fc71d7f885) Jan 19 16:40:13.243267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-605f81fa-877d-40ac-bc9d-d1fc71d7f885) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.244141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2e05b2c8-025d-4424-93d2-1063f7c17bc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4" status: 400 len: 269 microversion: 2.1 time: 0.148342 Jan 19 16:40:13.244698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 895/1588] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:40:13 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12/os-volume_attachments/48376b10-b1db-4320-8eb2-49131bc000e4 => generated 269 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:13.249346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.250203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.256628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.257082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.257917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.258400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.343991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 Jan 19 16:40:13.344607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 is not attached to volume 23c880a0-48ff-4e57-86f9-b1f98bf45533 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.345579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c39ef258-9098-42bf-8cc1-7aab113832e9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533" status: 404 len: 154 microversion: 2.20 time: 0.099829 Jan 19 16:40:13.346155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 896/1589] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jan 19 16:40:13 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments/23c880a0-48ff-4e57-86f9-b1f98bf45533 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:13.350985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.351802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.358499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.358953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.359775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.360216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.376187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] HTTP exception thrown: Instance 03b6bea3-3feb-4155-bea8-a36a587625b7 could not be found. Jan 19 16:40:13.376799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Returning 404 to user: Instance 03b6bea3-3feb-4155-bea8-a36a587625b7 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.377638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3c17d225-aa76-41c3-b8f3-be2281fc4923 tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 404 len: 111 microversion: 2.1 time: 0.030579 Jan 19 16:40:13.386700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 897/1590] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:40:13 2022] DELETE /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:13.386700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c40eb9f2-ac4d-4586-ba05-dc65aa2ac371 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.387154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c40eb9f2-ac4d-4586-ba05-dc65aa2ac371 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.394236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c40eb9f2-ac4d-4586-ba05-dc65aa2ac371 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.395232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c40eb9f2-ac4d-4586-ba05-dc65aa2ac371 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.396041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c40eb9f2-ac4d-4586-ba05-dc65aa2ac371 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.396480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c40eb9f2-ac4d-4586-ba05-dc65aa2ac371 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.426243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c40eb9f2-ac4d-4586-ba05-dc65aa2ac371 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Jan 19 16:40:13.426809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 898/1591] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:40:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:13.431027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d98569d-5f5d-48dc-b3c5-a5e91dcfddc9 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Calling method '.version_select at 0x7f7166fb8ee0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.442526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-9d98569d-5f5d-48dc-b3c5-a5e91dcfddc9 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 Jan 19 16:40:13.443118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d98569d-5f5d-48dc-b3c5-a5e91dcfddc9 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] Returning 404 to user: Keypair tempest-TestShelveInstance-377539102 not found for user ce2e4573f7214551ac4ad108cce8c429 {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.443970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9d98569d-5f5d-48dc-b3c5-a5e91dcfddc9 tempest-TestShelveInstance-1515285003 tempest-TestShelveInstance-1515285003-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102" status: 404 len: 142 microversion: 2.1 time: 0.016203 Jan 19 16:40:13.444513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 899/1592] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-377539102 => generated 142 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:13.448871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.449355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.456710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.456710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.458153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.458597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.493793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:40:13.583430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8427c724-6c18-468d-b2aa-977c62fa5fed tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 204 len: 0 microversion: 2.1 time: 0.137194 Jan 19 16:40:13.584061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 900/1593] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:40:13 2022] DELETE /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:40:13.593834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.594580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.600672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.601132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.601931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.602376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.615644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. Jan 19 16:40:13.616264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 404 to user: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.617092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f8c3dad1-b445-419b-8999-2815a077a407 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 404 len: 111 microversion: 2.1 time: 0.031769 Jan 19 16:40:13.617643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 901/1594] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:13 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:13.735437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-783c68a0-6614-4d98-ba84-17e15f4655b9 req-c407376c-5662-4809-b76f-e1b93e311fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b6bea3-3feb-4155-bea8-a36a587625b7", "name": "network-vif-deleted", "tag": "fbe468e6-a1b8-4690-8a22-7310a3f16008"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:13.736960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:40:13.736960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:40:13.743936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-783c68a0-6614-4d98-ba84-17e15f4655b9 req-c407376c-5662-4809-b76f-e1b93e311fff service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.744385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-783c68a0-6614-4d98-ba84-17e15f4655b9 req-c407376c-5662-4809-b76f-e1b93e311fff service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.755820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-783c68a0-6614-4d98-ba84-17e15f4655b9 req-c407376c-5662-4809-b76f-e1b93e311fff service nova] Creating event network-vif-deleted:fbe468e6-a1b8-4690-8a22-7310a3f16008 for instance 03b6bea3-3feb-4155-bea8-a36a587625b7 on hv-cinder-78447 Jan 19 16:40:13.761085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-783c68a0-6614-4d98-ba84-17e15f4655b9 req-c407376c-5662-4809-b76f-e1b93e311fff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142315 Jan 19 16:40:13.761870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 902/1595] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:13.768113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f21272dc-aa04-4e0b-9acf-a7f9a25c7f90 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.769109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f21272dc-aa04-4e0b-9acf-a7f9a25c7f90 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.776055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f21272dc-aa04-4e0b-9acf-a7f9a25c7f90 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.776511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f21272dc-aa04-4e0b-9acf-a7f9a25c7f90 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.777298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f21272dc-aa04-4e0b-9acf-a7f9a25c7f90 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.777737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f21272dc-aa04-4e0b-9acf-a7f9a25c7f90 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.806808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f21272dc-aa04-4e0b-9acf-a7f9a25c7f90 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043474 Jan 19 16:40:13.807650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 903/1596] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jan 19 16:40:13 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:40:13.811956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.812574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] [instance: 03b6bea3-3feb-4155-bea8-a36a587625b7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.819244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.819716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.820703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.820949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.838429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] HTTP exception thrown: Instance 03b6bea3-3feb-4155-bea8-a36a587625b7 could not be found. Jan 19 16:40:13.839034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] Returning 404 to user: Instance 03b6bea3-3feb-4155-bea8-a36a587625b7 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:13.839893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9a2dbc23-1810-4bc6-827b-41bb2598e46f tempest-VolumesActionsTest-1384728673 tempest-VolumesActionsTest-1384728673-project] 10.222.0.42 "GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7" status: 404 len: 111 microversion: 2.1 time: 0.031547 Jan 19 16:40:13.840690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 904/1597] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:13 2022] GET /compute/v2.1/servers/03b6bea3-3feb-4155-bea8-a36a587625b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:13.851698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:13.851698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:13.858630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.858630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:13.858630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:13.858630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:14.019191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:14.031925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9945194-425c-4d0f-ac4c-1b4f5cdc1877 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 200 len: 1514 microversion: 2.1 time: 0.190128 Jan 19 16:40:14.032814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 905/1598] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:13 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:40:14.045572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1076739857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-521557695", "security_groups": [{"name": "tempest-secgroup-smoke-792627283"}], "block_device_mapping_v2": [{"uuid": "842d5068-cc18-4b98-a5f8-6befddddd3e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "27a13afb-52ca-4667-a67d-ac2a2cf3df83"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:14.216888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] validate_networks() for [('27a13afb-52ca-4667-a67d-ac2a2cf3df83', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:40:15.161095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:40:15.161527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:40:15.162114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:40:15.162606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:40:15.163358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:40:15.177114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:15.178937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:15.179916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:15.180423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:15.202076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for project 27fc0bc850044ad690c3db4879b19c43. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:40:15.206440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Getting quotas for user b7616da9db584316b3a8ad4bb1ede6e8 and project 27fc0bc850044ad690c3db4879b19c43. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:40:15.273397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:40:15.276038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 094ce31e-9409-42a1-9b24-da12f1bdc6f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='842d5068-cc18-4b98-a5f8-6befddddd3e6',volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:40:15.343651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 842d5068-cc18-4b98-a5f8-6befddddd3e6 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-d265adb9-b3fd-4de2-9e91-bea9217698d5) Jan 19 16:40:15.344615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 842d5068-cc18-4b98-a5f8-6befddddd3e6 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-d265adb9-b3fd-4de2-9e91-bea9217698d5) {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:15.345350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1281aac4-5f1f-4a5d-9924-2989051728ab tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.311291 Jan 19 16:40:15.348261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 906/1599] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:40:14 2022] POST /compute/v2.1/servers => generated 295 bytes in 1313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:15.350827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:15.351294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:15.358344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:15.358904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:15.359860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:15.360334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:15.391405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:40:15.399646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.compute.api [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Working on deleting snapshot 2b51f00a-35a3-4ed7-b85f-b769c99ce0c7 from shelved instance... Jan 19 16:40:16.510332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Doing local delete in cell 64672888-0d64-4da8-bffb-e5ab20f1eacc(cell1) {{(pid=116210) _delete /opt/stack/nova/nova/compute/api.py:2439}} Jan 19 16:40:16.514594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:16.515064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:16.515657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.compute.api [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jan 19 16:40:16.526672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] deallocate_for_instance() {{(pid=116210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Jan 19 16:40:18.307051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Updating instance_info_cache with network_info: [] {{(pid=116210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 19 16:40:18.662456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.scheduler.client.report [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Deleted allocations for instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 Jan 19 16:40:18.914608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ac700e7-2f02-46ad-b7d1-18b8a95e5e54 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 204 len: 0 microversion: 2.20 time: 3.564657 Jan 19 16:40:18.915539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 907/1600] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jan 19 16:40:15 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 0 bytes in 3569 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:40:18.922555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3ded28df-c65d-47d5-85b8-75b54370b5aa tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:18.923650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3ded28df-c65d-47d5-85b8-75b54370b5aa tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:18.938507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ded28df-c65d-47d5-85b8-75b54370b5aa tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:18.938507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ded28df-c65d-47d5-85b8-75b54370b5aa tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:18.938507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ded28df-c65d-47d5-85b8-75b54370b5aa tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:18.938507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ded28df-c65d-47d5-85b8-75b54370b5aa tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.018044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3ded28df-c65d-47d5-85b8-75b54370b5aa tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action" status: 200 len: 76253 microversion: 2.1 time: 0.100218 Jan 19 16:40:19.020224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 908/1601] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:40:18 2022] POST /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66/action => generated 76253 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:40:19.026352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:19.029165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 2fd926e3-fc97-487a-b6aa-33983e63a1d7] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:19.040611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.041071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.042587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.043199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.064571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] HTTP exception thrown: Instance 2fd926e3-fc97-487a-b6aa-33983e63a1d7 could not be found. Jan 19 16:40:19.065187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Returning 404 to user: Instance 2fd926e3-fc97-487a-b6aa-33983e63a1d7 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:19.066182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f39998b3-0bf4-42b2-ba1d-918d7731fe7d tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7" status: 404 len: 111 microversion: 2.1 time: 0.044075 Jan 19 16:40:19.067399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 909/1602] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:19 2022] GET /compute/v2.1/servers/2fd926e3-fc97-487a-b6aa-33983e63a1d7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:19.073332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-6a833b28-4f59-4c31-9540-95f2c215af37 req-227ccaca-8718-4979-9554-3b5df254ce5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd926e3-fc97-487a-b6aa-33983e63a1d7", "name": "network-vif-deleted", "tag": "aa6e4e00-6dc4-4a81-8655-b0072a2d9ac8"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:19.075080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:40:19.075080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:40:19.084054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-6a833b28-4f59-4c31-9540-95f2c215af37 req-227ccaca-8718-4979-9554-3b5df254ce5b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.084506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-6a833b28-4f59-4c31-9540-95f2c215af37 req-227ccaca-8718-4979-9554-3b5df254ce5b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.098141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-6a833b28-4f59-4c31-9540-95f2c215af37 req-227ccaca-8718-4979-9554-3b5df254ce5b service nova] Creating event network-vif-deleted:aa6e4e00-6dc4-4a81-8655-b0072a2d9ac8 for instance 2fd926e3-fc97-487a-b6aa-33983e63a1d7 on hv-cinder-78447 Jan 19 16:40:19.107163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-6a833b28-4f59-4c31-9540-95f2c215af37 req-227ccaca-8718-4979-9554-3b5df254ce5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038275 Jan 19 16:40:19.108127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 910/1603] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:19.114134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:19.115717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:19.122657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.123116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.123947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.124538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.143077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. Jan 19 16:40:19.143723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 404 to user: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:19.145517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c7ffad97-da13-4361-a72e-2f019d93a76f tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "DELETE /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 404 len: 111 microversion: 2.1 time: 0.035539 Jan 19 16:40:19.146491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 911/1604] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:40:19 2022] DELETE /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:19.152297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:19.153166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:19.165792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.166513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.167609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.168084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.189257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 could not be found. Jan 19 16:40:19.190175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:19.191142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e6e03f9b-9b0a-4a29-948c-64536fec559b tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 404 len: 111 microversion: 2.20 time: 0.043529 Jan 19 16:40:19.192601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 912/1605] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:19 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:40:19.198204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:19.200837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [instance: 805b0677-e780-415d-8ce6-ca4ec1a0817a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:19.208192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.208655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.209459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:19.209904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:19.224062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] HTTP exception thrown: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. Jan 19 16:40:19.224695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Returning 404 to user: Instance 805b0677-e780-415d-8ce6-ca4ec1a0817a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:40:19.225533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8bd55dc7-1de9-4543-b3df-6488651d2d80 tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a" status: 404 len: 111 microversion: 2.1 time: 0.032026 Jan 19 16:40:19.226088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 913/1606] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:40:19 2022] GET /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:40:19.232171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b99eb97e-6351-4193-a631-36189f7051b5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '.version_select at 0x7f716c1c1b80>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:19.256552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b99eb97e-6351-4193-a631-36189f7051b5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-239286550" status: 204 len: 0 microversion: 2.20 time: 0.029362 Jan 19 16:40:19.257545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 914/1607] 10.222.0.42 () {60 vars in 1258 bytes} [Wed Jan 19 16:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-239286550 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:40:20.204435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-332df38b-724e-43d5-ae13-869f92f000f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'create', calling method: .version_select at 0x7f716fcbe700>, body: {"keypair": {"name": "tempest-keypair-1834581014"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:20.227743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-332df38b-724e-43d5-ae13-869f92f000f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:40:20.232078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-332df38b-724e-43d5-ae13-869f92f000f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for user 4316011b09014aa49ab3b3309340181e and project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:40:20.465630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-332df38b-724e-43d5-ae13-869f92f000f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:40:20.470192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-332df38b-724e-43d5-ae13-869f92f000f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for user 4316011b09014aa49ab3b3309340181e and project 49ce668b07c7476c8decace2497dc939. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:40:20.488074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-332df38b-724e-43d5-ae13-869f92f000f4 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.291187 Jan 19 16:40:20.494392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 915/1608] 10.222.0.42 () {62 vars in 1198 bytes} [Wed Jan 19 16:40:20 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 293 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 19 16:40:21.142052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-e549f030-1a42-49ae-af14-c9a894c2bb44 req-594e8add-5e78-47ff-b811-2ce62f589c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b42b29d-6ec2-4fd8-b110-48af10080a11", "name": "network-vif-deleted", "tag": "6cce95f3-aa82-488b-8999-5b073fe0fc80"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:21.143632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:40:21.143632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:40:21.151341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-e549f030-1a42-49ae-af14-c9a894c2bb44 req-594e8add-5e78-47ff-b811-2ce62f589c7c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:21.151827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-e549f030-1a42-49ae-af14-c9a894c2bb44 req-594e8add-5e78-47ff-b811-2ce62f589c7c service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:21.164268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.compute.server_external_events [req-e549f030-1a42-49ae-af14-c9a894c2bb44 req-594e8add-5e78-47ff-b811-2ce62f589c7c service nova] Unable to find a host for instance 2b42b29d-6ec2-4fd8-b110-48af10080a11. Dropping event network-vif-deleted {{(pid=116210) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 19 16:40:21.165457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-e549f030-1a42-49ae-af14-c9a894c2bb44 req-594e8add-5e78-47ff-b811-2ce62f589c7c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028236 Jan 19 16:40:21.166536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 916/1609] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 19 16:40:22.701368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-112411341", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc7ab358-3aa6-44a9-98b8-c481c542a661"}], "security_groups": [{"name": "tempest-securitygroup--1589184964"}], "key_name": "tempest-keypair-1834581014", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:22.850036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] validate_networks() for [('fc7ab358-3aa6-44a9-98b8-c481c542a661', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:40:23.374652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:40:23.375309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:40:23.376035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:40:23.376796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:40:23.377434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:40:23.388109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:23.388635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:23.389358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:23.389791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:23.407266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for project 49ce668b07c7476c8decace2497dc939. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:40:23.414119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Getting quotas for user 4316011b09014aa49ab3b3309340181e and project 49ce668b07c7476c8decace2497dc939. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:40:23.427471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:40:23.430045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:40:23.480898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-63aee056-a566-4c5b-aca4-172bf597742e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.783901 Jan 19 16:40:23.481683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 917/1610] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Jan 19 16:40:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 19 16:40:23.491868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-29d01f30-f32d-4316-8217-bd21c9ee6482 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:23.492534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-29d01f30-f32d-4316-8217-bd21c9ee6482 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:23.557695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-29d01f30-f32d-4316-8217-bd21c9ee6482 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:23.568247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-29d01f30-f32d-4316-8217-bd21c9ee6482 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:23.570165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-29d01f30-f32d-4316-8217-bd21c9ee6482 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:23.571482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-29d01f30-f32d-4316-8217-bd21c9ee6482 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1281 microversion: 2.20 time: 0.083943 Jan 19 16:40:23.572273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 918/1611] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:23 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:24.592573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:24.594034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:24.605539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:24.606488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:24.607609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:24.608109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:24.699835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:24.723230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:24.725674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:24.727163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b021d93-a19d-4706-b512-82af2ada8837 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1333 microversion: 2.20 time: 0.140976 Jan 19 16:40:24.727988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 919/1612] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:24 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:25.755990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:25.756768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:25.764179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:25.764827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:25.766028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:25.766716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:26.033243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:26.041886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:26.043424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:26.044555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-662f12dd-409d-463f-bb04-23e2167b68db tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1407 microversion: 2.20 time: 0.298091 Jan 19 16:40:26.045307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 920/1613] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:25 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:26.445207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-389f54c9-d6c1-4509-960e-4bfe8fd7b23e req-97562bcb-7691-4a6c-b6ca-82d0e7d9c58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacafabf-ccad-4e5d-bba3-6f72e63b6162", "tag": "4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:26.447258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:40:26.447258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:40:26.455734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-389f54c9-d6c1-4509-960e-4bfe8fd7b23e req-97562bcb-7691-4a6c-b6ca-82d0e7d9c58b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:26.456242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-389f54c9-d6c1-4509-960e-4bfe8fd7b23e req-97562bcb-7691-4a6c-b6ca-82d0e7d9c58b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:26.485315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-389f54c9-d6c1-4509-960e-4bfe8fd7b23e req-97562bcb-7691-4a6c-b6ca-82d0e7d9c58b service nova] Creating event network-changed:4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b for instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 on hv-cinder-78447 Jan 19 16:40:26.492317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-389f54c9-d6c1-4509-960e-4bfe8fd7b23e req-97562bcb-7691-4a6c-b6ca-82d0e7d9c58b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052232 Jan 19 16:40:26.493456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 921/1614] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:27.062733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:27.063559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:27.072010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:27.072466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:27.073254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:27.073693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:27.280919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:27.290131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:27.291709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:27.292847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c84f003f-48e3-4a61-a2ef-8b0f5c5d3033 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1407 microversion: 2.20 time: 0.234297 Jan 19 16:40:27.293396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 922/1615] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:27 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:28.311203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:28.311953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:28.318809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:28.319266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:28.320089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:28.320548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:28.454200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:28.462006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:28.463473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:28.464600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ebd78d74-5a8e-4635-a787-58402df22a80 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1407 microversion: 2.20 time: 0.157128 Jan 19 16:40:28.465173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 923/1616] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:28 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:29.482135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:29.482841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:29.491552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:29.491552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:29.491552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:29.491552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:29.617723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:29.625452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:29.626948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:29.628072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ad9681ca-933d-4a72-a6cf-124df2e29c93 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1407 microversion: 2.20 time: 0.149701 Jan 19 16:40:29.628637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 924/1617] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:29 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:30.646989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:30.647664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:30.653879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:30.654325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:30.655103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:30.655533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:30.796415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:30.804217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:30.805735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:30.806848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4b1499d2-5094-4ee7-938c-3e7c6a9070c6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1407 microversion: 2.20 time: 0.164639 Jan 19 16:40:30.807401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 925/1618] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:30 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:31.826086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:31.826723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:31.835364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:31.836194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:31.837033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:31.837809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:31.989965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:32.000396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:32.001902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:32.003014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7b7ae2eb-28fb-4c6d-a60d-761028551094 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1407 microversion: 2.20 time: 0.180795 Jan 19 16:40:32.003576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 926/1619] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:31 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:32.179118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-ac67d54f-f87e-43fb-9aa3-d3ed124abd6d req-b7e6059c-a458-4d2e-94fa-1f477299ddb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacafabf-ccad-4e5d-bba3-6f72e63b6162", "name": "network-vif-plugged", "status": "completed", "tag": "4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:32.180637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:40:32.180637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:40:32.187257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-ac67d54f-f87e-43fb-9aa3-d3ed124abd6d req-b7e6059c-a458-4d2e-94fa-1f477299ddb2 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:32.187712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-ac67d54f-f87e-43fb-9aa3-d3ed124abd6d req-b7e6059c-a458-4d2e-94fa-1f477299ddb2 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:32.198766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-ac67d54f-f87e-43fb-9aa3-d3ed124abd6d req-b7e6059c-a458-4d2e-94fa-1f477299ddb2 service nova] Creating event network-vif-plugged:4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b for instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 on hv-cinder-78447 Jan 19 16:40:32.203571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-ac67d54f-f87e-43fb-9aa3-d3ed124abd6d req-b7e6059c-a458-4d2e-94fa-1f477299ddb2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198331 Jan 19 16:40:32.204182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 927/1620] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:33.023009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:33.023758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:33.029822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:33.030273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:33.031054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:33.031497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:33.165391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:33.173303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:33.174810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:33.175960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fb3d7734-50fe-4496-9cef-a5320340d318 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1407 microversion: 2.20 time: 0.157876 Jan 19 16:40:33.176521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 928/1621] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:33 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:34.193443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:34.194083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:34.200352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:34.200808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:34.201582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:34.202019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:34.331304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:34.340487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:34.343384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:40:34.345050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0dbec0fc-0a01-4419-9782-c4a81ef90c01 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1599 microversion: 2.20 time: 0.155336 Jan 19 16:40:34.345955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 929/1622] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:40:34 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:34.368810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9eefe8ed-4a2f-4b0a-90dd-ef0f03fd4912 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:40:34.369311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9eefe8ed-4a2f-4b0a-90dd-ef0f03fd4912 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:34.375968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eefe8ed-4a2f-4b0a-90dd-ef0f03fd4912 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:34.376407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eefe8ed-4a2f-4b0a-90dd-ef0f03fd4912 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:34.377198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eefe8ed-4a2f-4b0a-90dd-ef0f03fd4912 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:34.377641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9eefe8ed-4a2f-4b0a-90dd-ef0f03fd4912 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:34.457397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9eefe8ed-4a2f-4b0a-90dd-ef0f03fd4912 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091747 Jan 19 16:40:34.458006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 930/1623] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Jan 19 16:40:34 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:40:35.781468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ee2f9471-c352-4072-ab72-00d35bd120a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:35.782756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ee2f9471-c352-4072-ab72-00d35bd120a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:35.792172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee2f9471-c352-4072-ab72-00d35bd120a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:35.792629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee2f9471-c352-4072-ab72-00d35bd120a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:35.793761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee2f9471-c352-4072-ab72-00d35bd120a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:35.793907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee2f9471-c352-4072-ab72-00d35bd120a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:35.859088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ee2f9471-c352-4072-ab72-00d35bd120a9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.082768 Jan 19 16:40:35.863153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 931/1624] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:35 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:35.865614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-6e822c3b-c1c4-4bef-ae88-481f6348e021 req-7734b37d-ed9a-4052-9d5c-f168bd9ecb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacafabf-ccad-4e5d-bba3-6f72e63b6162", "tag": "4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:35.868459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:40:35.868459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:40:35.875742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-6e822c3b-c1c4-4bef-ae88-481f6348e021 req-7734b37d-ed9a-4052-9d5c-f168bd9ecb28 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:35.876166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-6e822c3b-c1c4-4bef-ae88-481f6348e021 req-7734b37d-ed9a-4052-9d5c-f168bd9ecb28 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:35.887642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-6e822c3b-c1c4-4bef-ae88-481f6348e021 req-7734b37d-ed9a-4052-9d5c-f168bd9ecb28 service nova] Creating event network-changed:4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b for instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 on hv-cinder-78447 Jan 19 16:40:35.892637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-6e822c3b-c1c4-4bef-ae88-481f6348e021 req-7734b37d-ed9a-4052-9d5c-f168bd9ecb28 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031497 Jan 19 16:40:35.893944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 932/1625] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:40:36.871531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b6516328-710b-4b18-beef-2a4fa282ba73 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:36.872703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b6516328-710b-4b18-beef-2a4fa282ba73 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:36.885533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6516328-710b-4b18-beef-2a4fa282ba73 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:36.885997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6516328-710b-4b18-beef-2a4fa282ba73 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:36.887011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6516328-710b-4b18-beef-2a4fa282ba73 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:36.887451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6516328-710b-4b18-beef-2a4fa282ba73 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:36.959601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b6516328-710b-4b18-beef-2a4fa282ba73 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.092366 Jan 19 16:40:36.962737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 933/1626] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:36 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:40:37.970936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-78b40cb5-ec55-4863-be72-20f526a5ec9e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:37.972007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-78b40cb5-ec55-4863-be72-20f526a5ec9e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:37.979741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78b40cb5-ec55-4863-be72-20f526a5ec9e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:37.980198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78b40cb5-ec55-4863-be72-20f526a5ec9e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:37.981024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78b40cb5-ec55-4863-be72-20f526a5ec9e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:37.981609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78b40cb5-ec55-4863-be72-20f526a5ec9e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:38.049662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-78b40cb5-ec55-4863-be72-20f526a5ec9e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.082607 Jan 19 16:40:38.050423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 934/1627] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:37 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:39.060948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a2a7a31d-5a6c-42da-aa6f-a6d846e1c9f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:39.061947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a2a7a31d-5a6c-42da-aa6f-a6d846e1c9f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:39.070075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a7a31d-5a6c-42da-aa6f-a6d846e1c9f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:39.070527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a7a31d-5a6c-42da-aa6f-a6d846e1c9f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:39.071310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a7a31d-5a6c-42da-aa6f-a6d846e1c9f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:39.071769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a7a31d-5a6c-42da-aa6f-a6d846e1c9f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:39.134238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a2a7a31d-5a6c-42da-aa6f-a6d846e1c9f9 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.077271 Jan 19 16:40:39.137364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 935/1628] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:39 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:40.145327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3c7dc4d6-0e7d-463f-ae53-3cb1ddc4ecdc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:40.146906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3c7dc4d6-0e7d-463f-ae53-3cb1ddc4ecdc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:40.153707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7dc4d6-0e7d-463f-ae53-3cb1ddc4ecdc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:40.154167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7dc4d6-0e7d-463f-ae53-3cb1ddc4ecdc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:40.154944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7dc4d6-0e7d-463f-ae53-3cb1ddc4ecdc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:40.155381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c7dc4d6-0e7d-463f-ae53-3cb1ddc4ecdc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:40.213343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3c7dc4d6-0e7d-463f-ae53-3cb1ddc4ecdc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.071793 Jan 19 16:40:40.214161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 936/1629] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:40 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:41.224840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0fc822c7-a400-4010-9e30-e787ea6ab918 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:41.225850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0fc822c7-a400-4010-9e30-e787ea6ab918 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:41.233020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fc822c7-a400-4010-9e30-e787ea6ab918 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:41.233479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fc822c7-a400-4010-9e30-e787ea6ab918 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:41.234266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fc822c7-a400-4010-9e30-e787ea6ab918 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:41.234728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0fc822c7-a400-4010-9e30-e787ea6ab918 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:41.295904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0fc822c7-a400-4010-9e30-e787ea6ab918 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.074907 Jan 19 16:40:41.296575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 937/1630] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:41 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:42.306780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-327af22c-206d-4b75-8d19-daf92bcdde28 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:42.307871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-327af22c-206d-4b75-8d19-daf92bcdde28 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:42.314831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-327af22c-206d-4b75-8d19-daf92bcdde28 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:42.315285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-327af22c-206d-4b75-8d19-daf92bcdde28 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:42.316101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-327af22c-206d-4b75-8d19-daf92bcdde28 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:42.316542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-327af22c-206d-4b75-8d19-daf92bcdde28 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:42.375720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-327af22c-206d-4b75-8d19-daf92bcdde28 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.073289 Jan 19 16:40:42.376391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 938/1631] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:42 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:43.387296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f8055518-4774-4426-b52c-07f7a368c242 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:43.388503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f8055518-4774-4426-b52c-07f7a368c242 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:43.395541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8055518-4774-4426-b52c-07f7a368c242 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:43.396027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8055518-4774-4426-b52c-07f7a368c242 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:43.396836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8055518-4774-4426-b52c-07f7a368c242 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:43.397244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8055518-4774-4426-b52c-07f7a368c242 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:43.464105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f8055518-4774-4426-b52c-07f7a368c242 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.080573 Jan 19 16:40:43.464894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 939/1632] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:43 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:44.475208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-31888354-e335-4d05-8dd6-4dbd071e5496 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:44.476249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-31888354-e335-4d05-8dd6-4dbd071e5496 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:44.483288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31888354-e335-4d05-8dd6-4dbd071e5496 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:44.483770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31888354-e335-4d05-8dd6-4dbd071e5496 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:44.484558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31888354-e335-4d05-8dd6-4dbd071e5496 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:44.484998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31888354-e335-4d05-8dd6-4dbd071e5496 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:44.546779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-31888354-e335-4d05-8dd6-4dbd071e5496 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 14 microversion: 2.20 time: 0.075901 Jan 19 16:40:44.547398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 940/1633] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:44 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:40:45.558113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-adf64334-e299-4053-b13a-52c0969fcf34 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:45.559077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-adf64334-e299-4053-b13a-52c0969fcf34 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:45.566198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf64334-e299-4053-b13a-52c0969fcf34 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:45.566658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf64334-e299-4053-b13a-52c0969fcf34 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:45.567434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf64334-e299-4053-b13a-52c0969fcf34 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:45.567913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf64334-e299-4053-b13a-52c0969fcf34 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:45.655700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-adf64334-e299-4053-b13a-52c0969fcf34 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 8596 microversion: 2.20 time: 0.101488 Jan 19 16:40:45.656547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 941/1634] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:45 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 8596 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:40:46.667711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-254cd0b3-b6e4-46d6-9537-8aa8d9feb3b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:46.668689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-254cd0b3-b6e4-46d6-9537-8aa8d9feb3b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:46.675497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-254cd0b3-b6e4-46d6-9537-8aa8d9feb3b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:46.675975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-254cd0b3-b6e4-46d6-9537-8aa8d9feb3b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:46.676751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-254cd0b3-b6e4-46d6-9537-8aa8d9feb3b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:46.677788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-254cd0b3-b6e4-46d6-9537-8aa8d9feb3b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:46.760808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-254cd0b3-b6e4-46d6-9537-8aa8d9feb3b8 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 16639 microversion: 2.20 time: 0.097335 Jan 19 16:40:46.761480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 942/1635] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:46 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 16639 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:47.772738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cf2a568e-8d6c-45f9-8968-ad84a539a70e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:47.773755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cf2a568e-8d6c-45f9-8968-ad84a539a70e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:47.780686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cf2a568e-8d6c-45f9-8968-ad84a539a70e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:47.781144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cf2a568e-8d6c-45f9-8968-ad84a539a70e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:47.781928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cf2a568e-8d6c-45f9-8968-ad84a539a70e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:47.782370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cf2a568e-8d6c-45f9-8968-ad84a539a70e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:47.855845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cf2a568e-8d6c-45f9-8968-ad84a539a70e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 18663 microversion: 2.20 time: 0.086931 Jan 19 16:40:47.857306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 943/1636] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:47 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 18663 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:48.866931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b425538b-bcb8-4a20-b445-bb0fdfbb78ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:48.867955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b425538b-bcb8-4a20-b445-bb0fdfbb78ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:48.874823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b425538b-bcb8-4a20-b445-bb0fdfbb78ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:48.875272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b425538b-bcb8-4a20-b445-bb0fdfbb78ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:48.876104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b425538b-bcb8-4a20-b445-bb0fdfbb78ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:48.876545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b425538b-bcb8-4a20-b445-bb0fdfbb78ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:48.950346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b425538b-bcb8-4a20-b445-bb0fdfbb78ed tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 21104 microversion: 2.20 time: 0.087314 Jan 19 16:40:48.950995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 944/1637] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:48 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 21104 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:49.962125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-04b42910-374f-43f3-9fd2-eadadcebd222 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:49.963116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-04b42910-374f-43f3-9fd2-eadadcebd222 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:49.970085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b42910-374f-43f3-9fd2-eadadcebd222 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:49.970542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b42910-374f-43f3-9fd2-eadadcebd222 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:49.971333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b42910-374f-43f3-9fd2-eadadcebd222 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:49.971803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b42910-374f-43f3-9fd2-eadadcebd222 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:50.041284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-04b42910-374f-43f3-9fd2-eadadcebd222 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 23037 microversion: 2.20 time: 0.083014 Jan 19 16:40:50.042158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 945/1638] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:49 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 23037 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:51.052762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ee6f3fb9-c112-44e4-9ddd-be5d79872633 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:51.053749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ee6f3fb9-c112-44e4-9ddd-be5d79872633 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:51.060585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee6f3fb9-c112-44e4-9ddd-be5d79872633 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:51.061032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee6f3fb9-c112-44e4-9ddd-be5d79872633 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:51.061796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee6f3fb9-c112-44e4-9ddd-be5d79872633 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:51.062225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee6f3fb9-c112-44e4-9ddd-be5d79872633 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:51.136426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ee6f3fb9-c112-44e4-9ddd-be5d79872633 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 24426 microversion: 2.20 time: 0.087472 Jan 19 16:40:51.137062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 946/1639] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:51 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 24426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:52.148790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-75a9fe38-e028-4ab3-a7e0-e9b38a122544 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:52.149778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-75a9fe38-e028-4ab3-a7e0-e9b38a122544 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:52.156540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75a9fe38-e028-4ab3-a7e0-e9b38a122544 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:52.156986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75a9fe38-e028-4ab3-a7e0-e9b38a122544 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:52.157749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75a9fe38-e028-4ab3-a7e0-e9b38a122544 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:52.158177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75a9fe38-e028-4ab3-a7e0-e9b38a122544 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:52.229270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-75a9fe38-e028-4ab3-a7e0-e9b38a122544 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 26029 microversion: 2.20 time: 0.084845 Jan 19 16:40:52.229890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 947/1640] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:52 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 26029 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:53.242460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cc165581-a974-49e7-8b30-d29732928831 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:53.243455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cc165581-a974-49e7-8b30-d29732928831 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:53.249917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc165581-a974-49e7-8b30-d29732928831 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:53.250369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc165581-a974-49e7-8b30-d29732928831 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:53.251144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc165581-a974-49e7-8b30-d29732928831 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:53.251582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc165581-a974-49e7-8b30-d29732928831 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:53.327054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cc165581-a974-49e7-8b30-d29732928831 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 27275 microversion: 2.20 time: 0.089440 Jan 19 16:40:53.327723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 948/1641] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:53 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 27275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:54.338927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4719be8-ed6f-4dfd-85bf-def145fb4717 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:54.340558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4719be8-ed6f-4dfd-85bf-def145fb4717 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:54.348879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4719be8-ed6f-4dfd-85bf-def145fb4717 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:54.350251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4719be8-ed6f-4dfd-85bf-def145fb4717 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:54.351136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4719be8-ed6f-4dfd-85bf-def145fb4717 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:54.351580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4719be8-ed6f-4dfd-85bf-def145fb4717 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:54.429469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4719be8-ed6f-4dfd-85bf-def145fb4717 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 27967 microversion: 2.20 time: 0.094425 Jan 19 16:40:54.430092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 949/1642] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:54 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 27967 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:55.441532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-037e26d2-4717-423e-81a3-250250627e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:55.442517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-037e26d2-4717-423e-81a3-250250627e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:55.449990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037e26d2-4717-423e-81a3-250250627e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:55.450435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037e26d2-4717-423e-81a3-250250627e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:55.451210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037e26d2-4717-423e-81a3-250250627e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:55.451635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037e26d2-4717-423e-81a3-250250627e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:55.524940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-037e26d2-4717-423e-81a3-250250627e20 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 28213 microversion: 2.20 time: 0.087204 Jan 19 16:40:55.525517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 950/1643] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:55 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 28213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:56.637569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-150b866a-9807-4c0c-9f16-d518a956cbde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:56.639091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-150b866a-9807-4c0c-9f16-d518a956cbde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:56.646053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-150b866a-9807-4c0c-9f16-d518a956cbde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:56.646573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-150b866a-9807-4c0c-9f16-d518a956cbde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:56.647525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-150b866a-9807-4c0c-9f16-d518a956cbde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:56.648004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-150b866a-9807-4c0c-9f16-d518a956cbde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:56.712764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-150b866a-9807-4c0c-9f16-d518a956cbde tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 28213 microversion: 2.20 time: 0.179727 Jan 19 16:40:56.713398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 951/1644] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:56 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 28213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:57.725598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ca633894-0083-4ea2-b6fc-af8d184bad04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:57.726711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ca633894-0083-4ea2-b6fc-af8d184bad04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:57.733629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca633894-0083-4ea2-b6fc-af8d184bad04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:57.734069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca633894-0083-4ea2-b6fc-af8d184bad04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:57.734843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca633894-0083-4ea2-b6fc-af8d184bad04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:57.735272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca633894-0083-4ea2-b6fc-af8d184bad04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:57.810249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ca633894-0083-4ea2-b6fc-af8d184bad04 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 28503 microversion: 2.20 time: 0.089128 Jan 19 16:40:57.810904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 952/1645] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:57 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 28503 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:40:58.823100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e55f05f9-3fa9-4383-aa7a-e59579042867 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:58.824281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e55f05f9-3fa9-4383-aa7a-e59579042867 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:58.831112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e55f05f9-3fa9-4383-aa7a-e59579042867 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:58.831583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e55f05f9-3fa9-4383-aa7a-e59579042867 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:58.832413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e55f05f9-3fa9-4383-aa7a-e59579042867 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:58.832843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e55f05f9-3fa9-4383-aa7a-e59579042867 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:58.910435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e55f05f9-3fa9-4383-aa7a-e59579042867 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 28670 microversion: 2.20 time: 0.091836 Jan 19 16:40:58.911084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 953/1646] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:58 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 28670 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:40:59.923432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-03df0d4a-ca22-4b7d-a5a0-a3a16c83b061 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:40:59.924468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-03df0d4a-ca22-4b7d-a5a0-a3a16c83b061 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:40:59.931359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03df0d4a-ca22-4b7d-a5a0-a3a16c83b061 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:59.931880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03df0d4a-ca22-4b7d-a5a0-a3a16c83b061 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:59.932666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03df0d4a-ca22-4b7d-a5a0-a3a16c83b061 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:40:59.933104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-03df0d4a-ca22-4b7d-a5a0-a3a16c83b061 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:40:59.997418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-03df0d4a-ca22-4b7d-a5a0-a3a16c83b061 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 28670 microversion: 2.20 time: 0.078093 Jan 19 16:41:00.001350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 954/1647] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:40:59 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 28670 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:01.009914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e8109119-3077-471b-ba86-0d25f0d460d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:01.010914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e8109119-3077-471b-ba86-0d25f0d460d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:01.018120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8109119-3077-471b-ba86-0d25f0d460d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:01.018565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8109119-3077-471b-ba86-0d25f0d460d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:01.019329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8109119-3077-471b-ba86-0d25f0d460d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:01.019786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8109119-3077-471b-ba86-0d25f0d460d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:01.084833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e8109119-3077-471b-ba86-0d25f0d460d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 28670 microversion: 2.20 time: 0.078604 Jan 19 16:41:01.085475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 955/1648] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:01 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 28670 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:02.096658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09efd03b-7faa-4f03-83e2-8089cf24b4a2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:02.097677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09efd03b-7faa-4f03-83e2-8089cf24b4a2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:02.105127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09efd03b-7faa-4f03-83e2-8089cf24b4a2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:02.105585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09efd03b-7faa-4f03-83e2-8089cf24b4a2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:02.106370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09efd03b-7faa-4f03-83e2-8089cf24b4a2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:02.106813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09efd03b-7faa-4f03-83e2-8089cf24b4a2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:02.178920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09efd03b-7faa-4f03-83e2-8089cf24b4a2 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 30762 microversion: 2.20 time: 0.086078 Jan 19 16:41:02.179551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 956/1649] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:02 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 30762 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:03.190679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d8dd26a0-c7a8-413c-b6f4-70e3b78b6f2f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:03.191771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d8dd26a0-c7a8-413c-b6f4-70e3b78b6f2f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:03.198547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8dd26a0-c7a8-413c-b6f4-70e3b78b6f2f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:03.198990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8dd26a0-c7a8-413c-b6f4-70e3b78b6f2f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:03.199782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8dd26a0-c7a8-413c-b6f4-70e3b78b6f2f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:03.200216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d8dd26a0-c7a8-413c-b6f4-70e3b78b6f2f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:03.271242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d8dd26a0-c7a8-413c-b6f4-70e3b78b6f2f tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 32723 microversion: 2.20 time: 0.084425 Jan 19 16:41:03.271898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 957/1650] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:03 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 32723 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:04.283303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7c67b7dd-1302-4bfa-8e94-4d9bfe8700bc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:04.284337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7c67b7dd-1302-4bfa-8e94-4d9bfe8700bc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:04.292119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c67b7dd-1302-4bfa-8e94-4d9bfe8700bc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:04.292574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c67b7dd-1302-4bfa-8e94-4d9bfe8700bc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:04.293359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c67b7dd-1302-4bfa-8e94-4d9bfe8700bc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:04.293798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c67b7dd-1302-4bfa-8e94-4d9bfe8700bc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:04.369322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7c67b7dd-1302-4bfa-8e94-4d9bfe8700bc tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 33645 microversion: 2.20 time: 0.089912 Jan 19 16:41:04.369982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 958/1651] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:04 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 33645 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:05.381514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7fb88ed0-bb1c-48e7-add6-a162110de0f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:05.382518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7fb88ed0-bb1c-48e7-add6-a162110de0f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:05.390404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7fb88ed0-bb1c-48e7-add6-a162110de0f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:05.390857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7fb88ed0-bb1c-48e7-add6-a162110de0f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:05.391638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7fb88ed0-bb1c-48e7-add6-a162110de0f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:05.392097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7fb88ed0-bb1c-48e7-add6-a162110de0f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:05.467864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7fb88ed0-bb1c-48e7-add6-a162110de0f6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 34913 microversion: 2.20 time: 0.090189 Jan 19 16:41:05.472188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 959/1652] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:05 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 34913 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:06.480810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4b32cdeb-bc62-416d-96f0-07166fa0a087 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:06.481807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4b32cdeb-bc62-416d-96f0-07166fa0a087 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:06.488867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b32cdeb-bc62-416d-96f0-07166fa0a087 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:06.489352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b32cdeb-bc62-416d-96f0-07166fa0a087 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:06.490145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b32cdeb-bc62-416d-96f0-07166fa0a087 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:06.490586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b32cdeb-bc62-416d-96f0-07166fa0a087 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:06.564489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4b32cdeb-bc62-416d-96f0-07166fa0a087 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 36341 microversion: 2.20 time: 0.087608 Jan 19 16:41:06.565154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 960/1653] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:06 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 36341 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:07.577352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f48fa50b-f8b3-47a6-ad5a-4d3226c0d73a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:07.578364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f48fa50b-f8b3-47a6-ad5a-4d3226c0d73a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:07.585475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f48fa50b-f8b3-47a6-ad5a-4d3226c0d73a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:07.585936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f48fa50b-f8b3-47a6-ad5a-4d3226c0d73a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:07.586738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f48fa50b-f8b3-47a6-ad5a-4d3226c0d73a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:07.587181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f48fa50b-f8b3-47a6-ad5a-4d3226c0d73a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:07.663916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f48fa50b-f8b3-47a6-ad5a-4d3226c0d73a tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 37981 microversion: 2.20 time: 0.089832 Jan 19 16:41:07.665004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 961/1654] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:07 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 37981 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:08.676515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0af109a6-8ec5-401b-9dd8-0346b1c660cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:08.678139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0af109a6-8ec5-401b-9dd8-0346b1c660cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:08.693576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af109a6-8ec5-401b-9dd8-0346b1c660cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:08.694089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af109a6-8ec5-401b-9dd8-0346b1c660cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:08.695457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af109a6-8ec5-401b-9dd8-0346b1c660cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:08.695940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0af109a6-8ec5-401b-9dd8-0346b1c660cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:08.778173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0af109a6-8ec5-401b-9dd8-0346b1c660cb tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 38221 microversion: 2.20 time: 0.105720 Jan 19 16:41:08.779022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 962/1655] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:08 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 38221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:09.790643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5819d24a-7deb-4e74-bd70-3bacd69b83d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:09.791636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5819d24a-7deb-4e74-bd70-3bacd69b83d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:09.798452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5819d24a-7deb-4e74-bd70-3bacd69b83d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:09.798894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5819d24a-7deb-4e74-bd70-3bacd69b83d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:09.799698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5819d24a-7deb-4e74-bd70-3bacd69b83d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:09.800121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5819d24a-7deb-4e74-bd70-3bacd69b83d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:09.865190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5819d24a-7deb-4e74-bd70-3bacd69b83d6 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 38221 microversion: 2.20 time: 0.078664 Jan 19 16:41:09.865866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 963/1656] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:09 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 38221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:10.876903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8749c15e-66bf-43d4-8123-79bdbdc10581 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:10.877892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8749c15e-66bf-43d4-8123-79bdbdc10581 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:10.885467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8749c15e-66bf-43d4-8123-79bdbdc10581 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:10.885914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8749c15e-66bf-43d4-8123-79bdbdc10581 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:10.886690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8749c15e-66bf-43d4-8123-79bdbdc10581 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:10.887122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8749c15e-66bf-43d4-8123-79bdbdc10581 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:10.951533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8749c15e-66bf-43d4-8123-79bdbdc10581 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 38221 microversion: 2.20 time: 0.078551 Jan 19 16:41:10.955770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 964/1657] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:10 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 38221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:11.964052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4281609-7e21-40f5-82d7-15ce978e6aef tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:11.965061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4281609-7e21-40f5-82d7-15ce978e6aef tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:11.972391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4281609-7e21-40f5-82d7-15ce978e6aef tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:11.972963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4281609-7e21-40f5-82d7-15ce978e6aef tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:11.973763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4281609-7e21-40f5-82d7-15ce978e6aef tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:11.974207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4281609-7e21-40f5-82d7-15ce978e6aef tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:12.051779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4281609-7e21-40f5-82d7-15ce978e6aef tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 38242 microversion: 2.20 time: 0.091744 Jan 19 16:41:12.056597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 965/1658] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:11 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 38242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:13.064699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc2d745c-7062-4b78-8b09-1d3c4ff87051 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:41:13.065708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc2d745c-7062-4b78-8b09-1d3c4ff87051 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:13.073183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc2d745c-7062-4b78-8b09-1d3c4ff87051 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:13.073849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc2d745c-7062-4b78-8b09-1d3c4ff87051 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:13.074646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc2d745c-7062-4b78-8b09-1d3c4ff87051 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:13.075093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc2d745c-7062-4b78-8b09-1d3c4ff87051 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:13.146202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc2d745c-7062-4b78-8b09-1d3c4ff87051 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action" status: 200 len: 38362 microversion: 2.20 time: 0.085447 Jan 19 16:41:13.146848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 966/1659] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jan 19 16:41:13 2022] POST /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/action => generated 38362 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:41:13.156682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3e2a31b6-0e19-485d-8ee0-42a0b8da49f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:41:13.157281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3e2a31b6-0e19-485d-8ee0-42a0b8da49f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:41:13.164355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e2a31b6-0e19-485d-8ee0-42a0b8da49f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:13.164802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e2a31b6-0e19-485d-8ee0-42a0b8da49f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:13.165580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e2a31b6-0e19-485d-8ee0-42a0b8da49f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:41:13.166008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e2a31b6-0e19-485d-8ee0-42a0b8da49f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:41:13.189965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3e2a31b6-0e19-485d-8ee0-42a0b8da49f5 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/ips" status: 200 len: 151 microversion: 2.20 time: 0.036983 Jan 19 16:41:13.190522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 967/1660] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Jan 19 16:41:13 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:42:46.120156 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:42:46.120706 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:42:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:42:48.390319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:42:48.390820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:43:01.381962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:43:01.382564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:43:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:43:12.060500 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:43:12.061062 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:43:12.551198 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:43:12.551339 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:46:06.130965 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:46:06.131737 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:46:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:46:08.398538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:46:08.399100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:46:13.202502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f80afc26-1c27-48bc-8656-661cab22edee] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 19 16:46:13.206456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:13.206956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:13.212753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:13.213211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:13.213998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:13.214440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:13.239283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:46:13.297917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [b58f7751-1a21-4ed9-80da-06b10482903c] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 16:46:14.210895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] [f80afc26-1c27-48bc-8656-661cab22edee] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33728. Jan 19 16:46:14.304699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [b58f7751-1a21-4ed9-80da-06b10482903c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33732. Jan 19 16:46:14.324694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a69485dc-b257-49a4-9d98-6e7059dc3517 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 204 len: 0 microversion: 2.1 time: 1.124006 Jan 19 16:46:14.325420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 968/1661] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:46:13 2022] DELETE /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:46:14.333571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:14.334263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:14.339851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:14.340305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:14.341075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:14.341512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:14.523322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:14.531009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c68464ab-4829-47fd-ab2f-dd2b16afaf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.201035 Jan 19 16:46:14.532122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 969/1662] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:14 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:15.549461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:15.550074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:15.556093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:15.556557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:15.557333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:15.557770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:15.694016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:15.701799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1fb20978-e693-4de6-8dfa-c5f1b87eaf1a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.157003 Jan 19 16:46:15.702362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 970/1663] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:15 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:16.717841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:16.718454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:16.724661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:16.725123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:16.725899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:16.726338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:16.851965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:16.859818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aa294fd5-e148-486f-8212-238f8dd62194 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145514 Jan 19 16:46:16.860389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 971/1664] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:16 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:17.876271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:17.876891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:17.882784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:17.883168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:17.883961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:17.884393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:18.011156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:18.019192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f5339c39-2d22-4a93-a99a-54a2730a3444 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146509 Jan 19 16:46:18.019759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 972/1665] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:17 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:19.035483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:19.036110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:19.042618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:19.043072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:19.043896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:19.044340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:19.167890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:19.176099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5eae74f5-ae50-49bd-b523-71d1fcf83f49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144145 Jan 19 16:46:19.176657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 973/1666] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:19 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:19.806792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:19.807293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:19.813059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:19.813508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:19.814288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:19.814725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:19.840023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:46:19.929935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b30a576e-1c25-4efe-84d1-7da532d89c6b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 204 len: 0 microversion: 2.1 time: 0.126393 Jan 19 16:46:19.930757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 974/1667] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:46:19 2022] DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:46:19.937609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:19.938943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:19.944637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:19.945086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:19.945861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:19.946294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:19.971398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:46:20.048115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8fa6fff7-35b7-4762-85b4-027389fa00db tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 204 len: 0 microversion: 2.1 time: 0.114879 Jan 19 16:46:20.048844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 975/1668] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:46:19 2022] DELETE /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 19 16:46:20.054776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:20.055492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:20.061078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:20.061684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:20.062460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:20.063488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:20.220332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:20.228232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9daa9069-5ec7-4901-806b-3b4edccd2ba5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.178218 Jan 19 16:46:20.228782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 976/1669] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:20.233016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:20.233605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:20.239429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:20.239917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:20.240708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:20.241139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:20.366818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:20.373980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-14ebe789-2109-4616-99c4-be654a18d690 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 200 len: 1513 microversion: 2.1 time: 0.144282 Jan 19 16:46:20.374547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 977/1670] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:20 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:20.378657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-133a1bad-e51a-4721-9ea8-c9e1ad79c9ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] Calling method '.version_select at 0x7f716fc1d790>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:20.381805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-133a1bad-e51a-4721-9ea8-c9e1ad79c9ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [2ef5df74-aecd-4732-af09-590486fe80e5] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 16:46:21.389155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [None req-133a1bad-e51a-4721-9ea8-c9e1ad79c9ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] [2ef5df74-aecd-4732-af09-590486fe80e5] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33850. Jan 19 16:46:21.408881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-133a1bad-e51a-4721-9ea8-c9e1ad79c9ae tempest-TestVolumeBootPattern-1410066739 tempest-TestVolumeBootPattern-1410066739-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-521557695" status: 202 len: 0 microversion: 2.1 time: 1.033330 Jan 19 16:46:21.409466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 978/1671] 10.222.0.42 () {58 vars in 1259 bytes} [Wed Jan 19 16:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-521557695 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:46:21.414287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:21.414436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:21.422046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:21.422420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:21.423302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:21.423814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:21.555912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:21.564414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b013c072-074d-48a4-ac0e-53a1fae3bf74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153929 Jan 19 16:46:21.572071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 979/1672] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:21 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:21.629556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-5e92b0ae-805a-4733-8261-c4dd99be3748 req-c156b22e-c1de-48ae-a062-0a7b37a0dda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c468c7-0274-4ef8-97d8-8569a4e123b3", "name": "network-vif-deleted", "tag": "16baa7f0-2118-4683-91f3-22df6226182a"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:46:21.631159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:46:21.631159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:46:21.638107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-5e92b0ae-805a-4733-8261-c4dd99be3748 req-c156b22e-c1de-48ae-a062-0a7b37a0dda5 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:21.638559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-5e92b0ae-805a-4733-8261-c4dd99be3748 req-c156b22e-c1de-48ae-a062-0a7b37a0dda5 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:21.649812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-5e92b0ae-805a-4733-8261-c4dd99be3748 req-c156b22e-c1de-48ae-a062-0a7b37a0dda5 service nova] Creating event network-vif-deleted:16baa7f0-2118-4683-91f3-22df6226182a for instance f8c468c7-0274-4ef8-97d8-8569a4e123b3 on hv-cinder-78447 Jan 19 16:46:21.654547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-5e92b0ae-805a-4733-8261-c4dd99be3748 req-c156b22e-c1de-48ae-a062-0a7b37a0dda5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081042 Jan 19 16:46:21.655327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 980/1673] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:46:21.660563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:21.661262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:21.667593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:21.668080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:21.668867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:21.669311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.167264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:22.175648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-315b3d5f-472b-4a58-a6e2-f3c97e943a0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.519291 Jan 19 16:46:22.176246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 981/1674] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:22.180405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:22.181211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: f8c468c7-0274-4ef8-97d8-8569a4e123b3] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:22.186697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.187142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.188593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.189031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.201891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] HTTP exception thrown: Instance f8c468c7-0274-4ef8-97d8-8569a4e123b3 could not be found. Jan 19 16:46:22.202475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Returning 404 to user: Instance f8c468c7-0274-4ef8-97d8-8569a4e123b3 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:46:22.203283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3e3bb368-35c1-41a4-a2d2-af7e291c4d80 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3" status: 404 len: 111 microversion: 2.1 time: 0.026151 Jan 19 16:46:22.203845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 982/1675] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:22 2022] GET /compute/v2.1/servers/f8c468c7-0274-4ef8-97d8-8569a4e123b3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:46:22.211294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:22.211804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:22.217599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.218078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.218898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.219336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.243345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:46:22.318924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d10a9a91-72d2-478c-b4cf-ec0996b92ffa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 204 len: 0 microversion: 2.1 time: 0.110742 Jan 19 16:46:22.319787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 983/1676] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:46:22 2022] DELETE /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:46:22.329278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:22.329982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:22.335617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.336097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.336868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.337301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.552072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:22.559325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-56e517cb-bd37-4b37-afd4-3dd93a74487a tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1515 microversion: 2.1 time: 0.234158 Jan 19 16:46:22.560080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 984/1677] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:22 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:22.588260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:22.588872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:22.595005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.595452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.596309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:22.596769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:22.842668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:22.850919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4a22acc0-8c94-4b9c-af73-c6ce65e42fe9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.266901 Jan 19 16:46:22.851487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 985/1678] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:22 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:23.192232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:23.192915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:23.199095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:23.199539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:23.200360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:23.200794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:23.536976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:23.544922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eb07a757-c89c-41e2-9d4d-d51f3ec50e3d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.356410 Jan 19 16:46:23.545720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 986/1679] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:23.576625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:23.577505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:23.584499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:23.585101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:23.586141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:23.586576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:23.680052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:23.689464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8365b6d5-de8a-4082-a504-0cabea7d5b43 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 200 len: 1473 microversion: 2.1 time: 0.116573 Jan 19 16:46:23.690041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 987/1680] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:23 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 1473 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:23.741989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-1cf28e13-1b80-462a-a954-95d317df7c63 req-c3720d9e-448b-4ed3-893e-b39504b5838e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44764317-b47f-45aa-b59a-f4d2c5bc0480", "name": "network-vif-deleted", "tag": "45c123e8-df45-44e7-94a9-41f0b7c02a54"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:46:23.743858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:46:23.743858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:46:23.751993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-1cf28e13-1b80-462a-a954-95d317df7c63 req-c3720d9e-448b-4ed3-893e-b39504b5838e service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:23.752451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-1cf28e13-1b80-462a-a954-95d317df7c63 req-c3720d9e-448b-4ed3-893e-b39504b5838e service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:23.764951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-1cf28e13-1b80-462a-a954-95d317df7c63 req-c3720d9e-448b-4ed3-893e-b39504b5838e service nova] Creating event network-vif-deleted:45c123e8-df45-44e7-94a9-41f0b7c02a54 for instance 44764317-b47f-45aa-b59a-f4d2c5bc0480 on hv-cinder-78447 Jan 19 16:46:23.770224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-1cf28e13-1b80-462a-a954-95d317df7c63 req-c3720d9e-448b-4ed3-893e-b39504b5838e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031746 Jan 19 16:46:23.770828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 988/1681] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:46:23.870249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:23.871229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:23.878477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:23.878929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:23.879741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:23.880185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:24.123110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:24.133554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fb23f39b-9c2d-4a8e-87ee-12c91b6f9cab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.267882 Jan 19 16:46:24.151650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 989/1682] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:23 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:24.562187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:24.562825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:24.569853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:24.570474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:24.571258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:24.571897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:24.803599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:24.811308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-15e7a52b-d7c3-4c25-a860-c43cdddbf8b2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.252777 Jan 19 16:46:24.821478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 990/1683] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:24.821478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:24.821478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: 44764317-b47f-45aa-b59a-f4d2c5bc0480] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:24.822751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:24.823203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:24.824008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:24.824448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:24.838323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] HTTP exception thrown: Instance 44764317-b47f-45aa-b59a-f4d2c5bc0480 could not be found. Jan 19 16:46:24.838922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Returning 404 to user: Instance 44764317-b47f-45aa-b59a-f4d2c5bc0480 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:46:24.839781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ea7e02b-9f89-48eb-bccd-f9d1896a2cfa tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480" status: 404 len: 111 microversion: 2.1 time: 0.026945 Jan 19 16:46:24.840328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 991/1684] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:24 2022] GET /compute/v2.1/servers/44764317-b47f-45aa-b59a-f4d2c5bc0480 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:46:25.161454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:25.162037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:25.169344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:25.170012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:25.170833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:25.171787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:25.317315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:25.325202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0507b1bd-1528-4732-95f4-5f933ac4f81c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.170759 Jan 19 16:46:25.325767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 992/1685] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:25 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:25.833995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:25.835036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:25.841732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:25.842187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:25.843005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:25.843443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:26.086686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:26.095477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-86340084-508e-4c39-9ea0-0f2d8e4eb941 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.270130 Jan 19 16:46:26.096213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 993/1686] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:26.341913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:26.342526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:26.348246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:26.348696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:26.349475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:26.349914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:26.477240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:26.485265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-80ce5319-b56c-430c-bf8e-0122f1bddd3b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147063 Jan 19 16:46:26.485942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 994/1687] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:26 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:27.113246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:27.113953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:27.120680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:27.121126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:27.121921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:27.122354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:27.266339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:27.274444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0b3dcb65-6bea-43b4-8fd3-84fe5a56e994 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.165477 Jan 19 16:46:27.275028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 995/1688] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:27.502607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:27.503225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:27.509205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:27.509661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:27.510435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:27.510867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:27.645185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:27.659349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0944be6a-6e41-4d40-8d8d-03a147027ccc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.160983 Jan 19 16:46:27.659974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 996/1689] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:27 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:28.292519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:28.293871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:28.301317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:28.302038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:28.303052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:28.303729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:28.444784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:28.453264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff8878d7-fb66-4d78-a333-81a63343c263 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.164535 Jan 19 16:46:28.453850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 997/1690] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:28.677037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:28.677643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:28.686343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:28.686834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:28.687777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:28.688127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:28.833193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:28.841504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-62da1388-d4fd-4eca-aba8-2bf612c20d50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.168234 Jan 19 16:46:28.842489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 998/1691] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:28 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:46:29.470019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:29.471064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:29.477025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:29.477473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:29.478247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:29.478676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:29.673619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:29.682605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20927df5-dfac-4140-9ac8-3d3186ee4215 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.216085 Jan 19 16:46:29.683192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 999/1692] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:29.858105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:29.858746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:29.865150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:29.865602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:29.866374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:29.866810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:30.006015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:30.014239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-24f67bc1-1ea6-4fe5-b95a-fdfbecf3c40f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.159845 Jan 19 16:46:30.014809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1000/1693] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:29 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:30.700105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:30.700708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:30.707873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:30.708326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:30.709139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:30.709574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:30.839590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:30.847338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-13d55c6d-e128-4620-9647-bcce2e591a58 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150816 Jan 19 16:46:30.847933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1001/1694] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:31.029816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:31.030421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:31.036209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:31.036645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:31.037416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:31.037853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:31.162226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:31.170058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6a6b5d42-af6c-42b0-866e-6af104018b00 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.143734 Jan 19 16:46:31.170618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1002/1695] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:31 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:31.864320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:31.864954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:31.871136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:31.871587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:31.872416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:31.872842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:32.002685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:32.010363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ed391b3-794c-43cf-9234-257e836a189f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149693 Jan 19 16:46:32.010926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1003/1696] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:32.068598 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:46:32.069113 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:46:32.187350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:32.188018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:32.193853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:32.194306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:32.195086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:32.195527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:32.322105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:32.330664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fdc419d4-5fa6-4855-b26f-c1dab63c8fa4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146918 Jan 19 16:46:32.331261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1004/1697] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:32 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:32.561671 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:46:32.561841 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:46:33.027828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:33.028453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:33.035267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:33.035736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:33.036519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:33.036959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:33.161836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:33.169775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-44416ef0-e5d3-4ddc-ae61-d0105945bbca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145773 Jan 19 16:46:33.170342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1005/1698] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:33.347590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:33.348233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:33.353987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:33.354441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:33.355220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:33.355684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:33.485872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:33.493765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ceb16e5e-02ed-4342-ac63-d6de3af1e0c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150221 Jan 19 16:46:33.494342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1006/1699] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:33 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:34.187227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:34.187948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:34.194576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:34.195028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:34.196017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:34.196615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:34.321826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:34.329969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-85f9dcec-fe2b-4494-bd73-33a3374fe843 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146385 Jan 19 16:46:34.330531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1007/1700] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:34.510490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:34.511650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:34.518497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:34.518815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:34.519615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:34.520083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:34.661699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:34.669730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-524315ad-f03c-41e2-bcc4-595e0f48b6e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.163303 Jan 19 16:46:34.670298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1008/1701] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:34 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:35.347225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:35.347895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:35.354149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:35.354601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:35.355378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:35.355868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:35.487466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:35.495290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7837b868-cbf2-4f9d-b365-96881007925f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152192 Jan 19 16:46:35.495961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1009/1702] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:35.685879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:35.686494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:35.692479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:35.692933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:35.693718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:35.694160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:35.826825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:35.835008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-abaae80a-af2f-45c5-b86f-6b98b2e2a1a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152792 Jan 19 16:46:35.835557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1010/1703] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:35 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:36.517481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:36.518988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:36.525820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:36.526278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:36.527069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:36.527507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:36.656105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:36.663879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4e75695-3c4f-4d37-8d77-9d0257a89af4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.155028 Jan 19 16:46:36.664438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1011/1704] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:36.851462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:36.852248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:36.858394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:36.858852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:36.859628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:36.860745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:36.985839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:36.993572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32f95d23-68c4-4bd3-b07a-d510ddb51725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145807 Jan 19 16:46:36.994135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1012/1705] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:36 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:37.681727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:37.682679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:37.689161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:37.689609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:37.690383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:37.690813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:37.824193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:37.832005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5ba67c96-2d5d-40e1-8bbd-817a8d384e03 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.153833 Jan 19 16:46:37.832567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1013/1706] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:38.009948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:38.010556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:38.016906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:38.017353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:38.018130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:38.018561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:38.143044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:38.150671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-731e51b4-eadb-41ff-99ee-6874c3e1ec24 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144280 Jan 19 16:46:38.151235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1014/1707] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:38 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:38.848277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:38.848893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:38.855077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:38.855537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:38.856432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:38.856896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:38.986213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:38.993854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f09f5f7-e476-4e01-8d18-35b17cd7a099 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149147 Jan 19 16:46:38.994422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1015/1708] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:39.168029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:39.168560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:39.174926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:39.175376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:39.176177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:39.176615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:39.301888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:39.309623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-46b8181e-3b01-42c5-931c-c3c4d135cdc8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145340 Jan 19 16:46:39.310187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1016/1709] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:39 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:40.011656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:40.012345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:40.019182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:40.019637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:40.020441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:40.020884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:40.147862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:40.155516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09f9ad2d-a0c1-4730-8c91-d35742e1e0a3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147505 Jan 19 16:46:40.156124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1017/1710] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:40.326087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:40.326822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:40.332816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:40.333293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:40.334081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:40.334549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:40.463640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:40.472022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b3389a1d-1b26-4ca5-be6d-1e63a7d6a622 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149462 Jan 19 16:46:40.473158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1018/1711] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:40 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:41.172719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:41.173368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:41.179546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:41.180026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:41.180798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:41.181229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:41.311320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:41.318931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-87dde919-9e25-4b43-9099-a9ee4d0b2688 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150267 Jan 19 16:46:41.319495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1019/1712] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:41.489420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:41.490022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:41.495773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:41.496224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:41.496991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:41.497457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:41.628271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:41.635915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5e6d75c4-1b7d-40d8-aee2-c779607d5cb3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149995 Jan 19 16:46:41.636470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1020/1713] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:41 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:42.335457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:42.336151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:42.342268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:42.342721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:42.343482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:42.343960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:42.470095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:42.478109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aedaf094-8fa0-4941-b1f2-29b0680f8de5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146381 Jan 19 16:46:42.478684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1021/1714] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:42.652871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:42.653456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:42.659985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:42.660429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:42.661192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:42.661618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:42.790827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:42.798522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e72eb6a6-27a0-491b-8a66-030d6331775f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149344 Jan 19 16:46:42.799079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1022/1715] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:42 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:43.495339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:43.496081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:43.503120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:43.503610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:43.504431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:43.504873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:43.635721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:43.643388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-56f1f042-c83d-4545-8983-75e8755b1089 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151707 Jan 19 16:46:43.643984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1023/1716] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:43.814811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:43.815424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:43.821301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:43.821752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:43.822556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:43.822985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:43.963049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:43.971595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3bc46215-ae3b-4c5e-975f-05b808615285 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.160391 Jan 19 16:46:43.972200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1024/1717] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:43 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:44.660271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:44.660899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:44.667001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:44.667456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:44.668274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:44.668716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:44.799077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:44.807185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7c791850-774a-4021-aa6e-91aba04ae341 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150779 Jan 19 16:46:44.807770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1025/1718] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:44.988359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:44.988973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:44.994676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:44.995127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:44.995932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:44.996378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:45.124353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:45.132061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b3452fef-c7fe-49c9-a172-3f221ce7e80f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147785 Jan 19 16:46:45.132622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1026/1719] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:44 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:45.823959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:45.824567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:45.831274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:45.831751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:45.832529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:45.832959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:45.965220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:45.972918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3419409d-3ea5-4597-a8b3-5291135bc5a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152673 Jan 19 16:46:45.973480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1027/1720] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:46.148599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:46.149209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:46.155036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:46.155486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:46.156282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:46.156720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:46.284264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:46.292146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-60f18862-437c-4b15-9309-aa04ef04eb22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147122 Jan 19 16:46:46.292715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1028/1721] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:46 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:46.989537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:46.990126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:46.996383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:46.996834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:46.997602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:46.998038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:47.125135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:47.132934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-daf72416-ab3f-4ba1-bb32-5315e47976b5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146969 Jan 19 16:46:47.133509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1029/1722] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:47.309067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:47.309708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:47.316119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:47.316574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:47.317353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:47.317904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:47.447573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:47.455987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-25c0320c-d3ab-40c3-b86f-1726f779cad2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150525 Jan 19 16:46:47.456555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1030/1723] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:47 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:48.150062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:48.150660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:48.157696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:48.158135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:48.158918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:48.159357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:48.286944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:48.294895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f0fd0082-af81-40b7-ba04-7bf487c49918 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148507 Jan 19 16:46:48.295457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1031/1724] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:48.472373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:48.473011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:48.478757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:48.479214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:48.480030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:48.480476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:48.605661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:48.613798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4bba2ee4-7640-4cf8-a749-c2276bf48e5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145066 Jan 19 16:46:48.614361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1032/1725] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:48 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:49.312147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:49.312759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:49.318927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:49.319444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:49.320249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:49.320693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:49.449751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:49.457900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cabce645-1ea2-4844-9404-7524829372ee tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149288 Jan 19 16:46:49.458461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1033/1726] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:49.631289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:49.631927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:49.637684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:49.638123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:49.638891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:49.639378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:49.764437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:49.772912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7b7d1994-4487-438a-a90b-5e128d847be0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145443 Jan 19 16:46:49.773473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1034/1727] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:49 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:50.475122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:50.476018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:50.482249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:50.482699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:50.483463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:50.483917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:50.615798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:50.623375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9479cab7-16ac-4246-9a5f-a9bfd614473b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151927 Jan 19 16:46:50.623963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1035/1728] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:50.789405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:50.790021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:50.796127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:50.796584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:50.797369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:50.797810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:50.923052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:50.930718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ddd01abf-9822-4380-a67e-d56e1e90722a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144947 Jan 19 16:46:50.931280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1036/1729] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:50 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:51.640218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:51.640842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:51.646946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:51.647392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:51.648173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:51.648604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:51.776741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:51.784803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d290cec5-3af8-4cc4-864d-c08cd3c99285 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148272 Jan 19 16:46:51.785358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1037/1730] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:51.947057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:51.947598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:51.953417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:51.953875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:51.954657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:51.955096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:52.083406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:52.091030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f2884719-db86-4788-a17e-87ae892fe9f2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147531 Jan 19 16:46:52.091596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1038/1731] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:51 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:52.801644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:52.802253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:52.808457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:52.808902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:52.809670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:52.810101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:52.935484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:52.943108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-80f6143a-c099-40ef-87cf-7b778ac8d7a5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145050 Jan 19 16:46:52.943693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1039/1732] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:53.107979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:53.108588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:53.114480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:53.114929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:53.115727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:53.116170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:53.246160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:53.254391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e01e5d8d-c4e6-4645-8c7f-cfbbfcf4da5a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149877 Jan 19 16:46:53.254958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1040/1733] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:53 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:53.959797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:53.960419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:53.966667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:53.967120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:53.967923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:53.968369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:54.101801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:54.110116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-41801c05-9a9b-4bcf-be44-c5c8047e6e9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.153313 Jan 19 16:46:54.110688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1041/1734] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:54.269781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:54.270382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:54.276119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:54.276565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:54.277323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:54.277750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:54.407341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:54.415315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-522e50ad-a325-426f-99f3-57878c974926 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149029 Jan 19 16:46:54.416443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1042/1735] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:54 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:55.127506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:55.128149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:55.134282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:55.134721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:55.135480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:55.135948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:55.261387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:55.271380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c7575795-b873-4aa7-b3ec-f944c5d0041f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147991 Jan 19 16:46:55.272538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1043/1736] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:55.432204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:55.432824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:55.439071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:55.439524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:55.440336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:55.440781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:55.569313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:55.577145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f5921fb-5a93-4f64-953e-5c633f9b9d3e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148494 Jan 19 16:46:55.577716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1044/1737] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:55 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:56.288276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:56.289050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:56.295315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:56.295798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:56.296575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:56.297011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:56.426045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:56.433710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-361422d3-f4ad-466b-b184-b63ae1bab12b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149038 Jan 19 16:46:56.434278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1045/1738] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:56.592997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:56.593608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:56.599461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:56.599941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:56.600717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:56.601158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:56.728833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:56.736451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a4f9c53f-e3a7-469a-8967-bebe60d7d7bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147271 Jan 19 16:46:56.737012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1046/1739] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:56 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:57.451184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:57.451831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:57.458387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:57.458839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:57.459614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:57.460078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:57.590200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:57.597989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-67fa1fd0-3927-468e-a1f6-6202a67b4712 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150559 Jan 19 16:46:57.598544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1047/1740] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:57.753050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:57.753700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:57.759510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:57.760001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:57.760797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:57.761233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:57.886152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:57.894195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-46afa35b-5a79-4392-a02c-40bedef46b87 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145363 Jan 19 16:46:57.894703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1048/1741] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:57 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:58.614641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:58.615210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:58.621228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:58.621671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:58.622437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:58.622868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:58.754264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:58.761914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-70f1aad6-9dc0-4f93-8a76-9a2827da8954 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150992 Jan 19 16:46:58.762473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1049/1742] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:58.910409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:58.911018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:58.917135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:58.917582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:58.918349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:58.918784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:59.041850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:59.050014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-86c47720-cbe0-45bc-bf8a-5d6fc366e8c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.143244 Jan 19 16:46:59.050576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1050/1743] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:58 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:46:59.778576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:46:59.779331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:46:59.785550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:59.786007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:59.786783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:46:59.787227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:46:59.914988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:46:59.923430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-53af8027-d08d-451c-90e0-2eacd7173640 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148467 Jan 19 16:46:59.924038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1051/1744] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:46:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:00.066249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:00.066801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:00.072524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:00.072968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:00.073725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:00.074156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:00.202983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:00.210590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bc11c860-f406-492a-84b6-be175d18d872 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147865 Jan 19 16:47:00.211145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1052/1745] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:00 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:00.940270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:00.940903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:00.947244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:00.947725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:00.948543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:00.949012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:01.073728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:01.082063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-44f3eeb8-eb37-4f6e-8988-67609278da38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145481 Jan 19 16:47:01.082637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1053/1746] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:01.227269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:01.227911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:01.233675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:01.234137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:01.234946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:01.235388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:01.362076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:01.369815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-952df935-9e7d-4e4c-a88a-1ac356c2a725 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146019 Jan 19 16:47:01.370383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1054/1747] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:01 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:02.098130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:02.098763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:02.104924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:02.105384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:02.106159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:02.106600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:02.236749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:02.244356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7a67e282-488f-4e29-bebd-03a00d1933ff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149922 Jan 19 16:47:02.244926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1055/1748] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:02.385602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:02.386143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:02.392025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:02.392474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:02.393239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:02.393675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:02.520912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:02.528536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40ac2065-7f86-4081-9c6c-186d36d450ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146347 Jan 19 16:47:02.529096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1056/1749] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:02 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:03.261613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:03.262281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:03.269135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:03.269601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:03.270369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:03.270839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:03.398644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:03.406299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-24e9b310-d1fe-41f6-9cb7-788b354fc199 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148317 Jan 19 16:47:03.406870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1057/1750] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:03.545835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:03.546360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:03.552919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:03.553372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:03.554146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:03.554579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:03.681074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:03.689451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6bc1d8fe-abb9-4732-b06f-e22bcdb04cbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147288 Jan 19 16:47:03.690021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1058/1751] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:03 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:04.423339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:04.424013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:04.430297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:04.430733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:04.431510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:04.431975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:04.560794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:04.569106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8e511e01-06e5-4322-8099-a41dcc1167a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149498 Jan 19 16:47:04.569659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1059/1752] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:04.706486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:04.707133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:04.712955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:04.713398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:04.714162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:04.714588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:04.839620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:04.847335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d0d80ea-1315-4c17-bdda-5986af1e6ad9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145067 Jan 19 16:47:04.847936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1060/1753] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:04 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:05.586497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:05.587176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:05.593355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:05.593837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:05.594605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:05.595044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:05.730589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:05.738426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9057b5e3-e7c5-45b6-ac10-788ab0ee3701 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.155522 Jan 19 16:47:05.739067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1061/1754] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:05.863832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:05.864430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:05.870162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:05.870605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:05.871364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:05.871833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:06.246715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:06.254924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e1561b64-ddd3-4b74-8060-de732ea40f1f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.394625 Jan 19 16:47:06.255486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1062/1755] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:05 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:06.755656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:06.756287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:06.762664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:06.763109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:06.763917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:06.764358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:06.889839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:06.897507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-750b4d56-779e-4abb-b1cc-541ee3674a2c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145455 Jan 19 16:47:06.898063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1063/1756] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:07.271408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:07.272040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:07.277906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:07.278337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:07.279095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:07.279523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:07.407601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:07.415319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0e25bdab-ea33-4481-8922-4d620abd8377 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147539 Jan 19 16:47:07.416194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1064/1757] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:07 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:07.914519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:07.915148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:07.921529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:07.922464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:07.923221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:07.923650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:08.055477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:08.063829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc3e86d7-3bc3-4e01-afb5-2ef781301d4f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152794 Jan 19 16:47:08.064397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1065/1758] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:08.432866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:08.433395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:08.439315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:08.439804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:08.440578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:08.441012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:08.720272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:08.727862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45ca6e59-350d-42b6-82f9-c7fbbc3e54a2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.298625 Jan 19 16:47:08.728415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1066/1759] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:08 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:09.081107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:09.081700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:09.087930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:09.088374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:09.089142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:09.089571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:09.215184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:09.222918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-10a2ad36-3902-44e9-b50e-3605b2215a22 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146075 Jan 19 16:47:09.223481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1067/1760] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:09.744288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:09.744901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:09.751337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:09.751847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:09.752621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:09.753064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:09.878314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:09.886176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ea046bb-9479-40f2-8ec8-345a6a7e18dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145474 Jan 19 16:47:09.886747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1068/1761] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:09 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:10.239357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:10.240027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:10.246116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:10.246559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:10.247325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:10.247793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:10.374686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:10.382192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c85965a6-6472-4e0c-b462-7142ffce34be tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146382 Jan 19 16:47:10.382742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1069/1762] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:10.902057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:10.902672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:10.908653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:10.909101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:10.909868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:10.910302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:11.035486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:11.043349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f8457322-8c8b-4e01-a47a-62ed49b639b9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144941 Jan 19 16:47:11.043930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1070/1763] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:10 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:11.399327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:11.399987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:11.406766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:11.407220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:11.408022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:11.408483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:11.538407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:11.546514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-78f0fd36-e50b-4ddb-a449-a4a81102737a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150791 Jan 19 16:47:11.547628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1071/1764] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:12.060198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:12.060817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:12.067054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:12.067510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:12.068322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:12.068762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:12.198301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:12.206731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d7e82d85-c5dd-43a3-a8ef-3e8e8a6b4583 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150146 Jan 19 16:47:12.207517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1072/1765] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:12 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:12.563909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:12.564567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:12.570659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:12.571113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:12.571917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:12.572368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:12.702300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:12.710484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-afa18523-62a2-45a7-9837-6a8c05f8e857 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150298 Jan 19 16:47:12.711039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1073/1766] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:13.223054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:13.223697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:13.230001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.230563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.231356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.231829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.360166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:13.368094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-803f00a9-eb05-421b-9a5b-937bf0a893e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148603 Jan 19 16:47:13.368657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1074/1767] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:13 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:13.372842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:13.373335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:13.379445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.379943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.380716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.381158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.404546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:47:13.477417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dae5e3b8-938c-41b9-a576-9f0d32f6c417 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 204 len: 0 microversion: 2.20 time: 0.107454 Jan 19 16:47:13.478123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1075/1768] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jan 19 16:47:13 2022] DELETE /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 19 16:47:13.487219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:13.487957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:13.493563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.494053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.494830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.495275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.623589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:13.632005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:13.633333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:13.634482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-abebd0a4-7db2-4814-b159-6405893b4065 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1723 microversion: 2.20 time: 0.151952 Jan 19 16:47:13.635330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1076/1769] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:47:13 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 19 16:47:13.727865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:13.728391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:13.734861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.735317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.736384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:13.736822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:13.866732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:13.875190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a4dfeac3-0618-4fc2-80b2-f5d34f969e83 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151083 Jan 19 16:47:13.875783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1077/1770] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:14.384706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:14.385516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:14.393084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:14.393548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:14.394366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:14.394871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:14.642877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:14.656521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ab1a0a3-ffb7-4d7a-91fc-d8fd366d0f96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.275281 Jan 19 16:47:14.657277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1078/1771] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:14 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:14.662397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:14.663310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:14.670597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:14.671051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:14.672401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:14.673020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:14.760392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:14.768300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:14.769798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4316011b09014aa49ab3b3309340181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ce668b07c7476c8decace2497dc939', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:14.770953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c1401fbd-1e17-458c-b8d0-1dd2400fe2c1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 200 len: 1655 microversion: 2.20 time: 0.112603 Jan 19 16:47:14.771518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1079/1772] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:47:14 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 1655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 19 16:47:14.863523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-fdf5ceed-d0ff-438d-8a4c-bd87ee536d5e req-b50d43e0-a9c4-4ed9-bb13-afb7cfbc4f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacafabf-ccad-4e5d-bba3-6f72e63b6162", "name": "network-vif-deleted", "tag": "4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:47:14.865288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:47:14.865288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:47:14.872736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-fdf5ceed-d0ff-438d-8a4c-bd87ee536d5e req-b50d43e0-a9c4-4ed9-bb13-afb7cfbc4f02 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:14.873250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-fdf5ceed-d0ff-438d-8a4c-bd87ee536d5e req-b50d43e0-a9c4-4ed9-bb13-afb7cfbc4f02 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:14.885130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-fdf5ceed-d0ff-438d-8a4c-bd87ee536d5e req-b50d43e0-a9c4-4ed9-bb13-afb7cfbc4f02 service nova] Creating event network-vif-deleted:4fd5c7ef-fb0b-4db2-84d7-c8d42c4c634b for instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 on hv-cinder-78447 Jan 19 16:47:14.890385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-fdf5ceed-d0ff-438d-8a4c-bd87ee536d5e req-b50d43e0-a9c4-4ed9-bb13-afb7cfbc4f02 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030818 Jan 19 16:47:14.894292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1080/1773] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:47:14.899741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:14.901053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:14.908888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:14.909574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:14.910870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:14.911461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:15.064374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:15.074973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-46f27c27-b97e-49f0-a03a-722b6b335757 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.179477 Jan 19 16:47:15.076106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1081/1774] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:47:15.673921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:15.674524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:15.684648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:15.685103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:15.685896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:15.686327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:15.816110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:15.823752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dbf037dd-5d83-41c6-a21b-5dbbba6357b3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153506 Jan 19 16:47:15.824315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1082/1775] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:15 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:47:15.829000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:15.829596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:15.835098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:15.835560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:15.836490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:15.837026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:15.850183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 could not be found. Jan 19 16:47:15.850773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:47:15.851590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b7ab5ecc-992b-4109-b515-e2b8a5914438 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 404 len: 111 microversion: 2.20 time: 0.026384 Jan 19 16:47:15.852167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1083/1776] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:47:15 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:47:15.860460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d61e588-6137-420d-99d8-85a592806a2e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '.version_select at 0x7f716fc33310>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:15.879923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d61e588-6137-420d-99d8-85a592806a2e tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834581014" status: 204 len: 0 microversion: 2.20 time: 0.023131 Jan 19 16:47:15.883784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1084/1777] 10.222.0.42 () {60 vars in 1261 bytes} [Wed Jan 19 16:47:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834581014 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 19 16:47:16.092384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:16.093113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:16.099027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:16.099574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:16.100446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:16.100954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:16.288979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:16.297892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a5d2985d-fd5a-4591-9437-6edf78645bc9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.209205 Jan 19 16:47:16.298547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1085/1778] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:16.841130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:16.841739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:16.848455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:16.848908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:16.849682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:16.850116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:16.977929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:16.985612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c5ff89a2-e5fc-441e-ae20-7bca5e56e401 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148202 Jan 19 16:47:16.986170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1086/1779] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:16 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:17.314694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:17.315306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:17.321613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:17.322071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:17.322877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:17.323387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:17.459303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:17.467087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bcf13ea3-9f87-4491-a0ac-7cf3d81303ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.156415 Jan 19 16:47:17.467579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1087/1780] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:18.002861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:18.004920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:18.009649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:18.010094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:18.010859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:18.011294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:18.135275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:18.142833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a10315c2-dc3d-477e-b93c-d8b13f27a21a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144298 Jan 19 16:47:18.143386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1088/1781] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:17 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:18.484995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:18.485614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:18.492024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:18.492477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:18.493273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:18.493711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:18.625253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:18.633006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aae511e3-5772-466d-98dd-4bad1432be50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152433 Jan 19 16:47:18.633567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1089/1782] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:19.159026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:19.159636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:19.166094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:19.166554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:19.167327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:19.167793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:19.296293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:19.304469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b971793f-af09-4749-b7e6-7cc2545aab22 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149099 Jan 19 16:47:19.305036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1090/1783] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:19 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:19.652612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:19.653230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:19.659443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:19.659936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:19.660713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:19.661202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:19.786945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:19.794831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ee1e176d-2019-4079-a143-d486fb23c740 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145797 Jan 19 16:47:19.795399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1091/1784] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:47:20.320954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:20.321594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:20.328520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:20.328978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:20.329750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:20.330192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:20.462625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:20.470397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-169695d0-4941-4ac8-9e68-270a791c628f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153049 Jan 19 16:47:20.470969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1092/1785] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:20 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:20.812123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:20.813314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:20.819169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:20.819624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:20.820426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:20.820868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:20.946914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:20.954684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7b3e5b02-6088-4a96-a53b-e9c43b969311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146152 Jan 19 16:47:20.955265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1093/1786] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:21.485924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:21.486541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:21.492891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:21.493353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:21.494135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:21.494577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:21.624794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:21.632848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b99f3308-2f9b-46db-b3a8-986aea337746 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150520 Jan 19 16:47:21.633401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1094/1787] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:21 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:21.971100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:21.971733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:21.977555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:21.978001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:21.978768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:21.979202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:22.106848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:22.115070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eda788f3-6942-41dd-9a40-33ca29325571 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147574 Jan 19 16:47:22.115632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1095/1788] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:22.649708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:22.650326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:22.657229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:22.657682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:22.658462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:22.658906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:22.788506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:22.796425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bde88e6b-54ee-4a8b-a024-e8f0f766046a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150318 Jan 19 16:47:22.797874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1096/1789] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:22 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:23.131662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:23.132252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:23.138511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:23.138970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:23.139769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:23.140215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:23.269201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:23.276911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9231c5b-6ff1-40cf-9c4e-6e759d6a0266 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148918 Jan 19 16:47:23.277476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1097/1790] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:23.813958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:23.814574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:23.820895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:23.821343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:23.822116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:23.822551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:23.950692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:23.958265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1b04a9b7-6b3b-4155-838a-c52ed2c4ead2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148490 Jan 19 16:47:23.958816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1098/1791] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:23 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:47:24.293881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:24.294497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:24.301009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:24.301465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:24.302241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:24.302682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:24.432544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:24.440226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-661bdf04-40b5-4f34-89e7-c130f7e944f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150193 Jan 19 16:47:24.440789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1099/1792] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:24.974203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:24.974851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:24.981488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:24.981942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:24.982721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:24.983158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:25.110786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:25.118604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bf961ff5-b5f9-48e8-a4b7-8091aca4a5f5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148012 Jan 19 16:47:25.119190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1100/1793] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:24 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:25.456971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:25.457620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:25.463427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:25.463923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:25.464694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:25.465142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:25.592233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:25.600543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3ffc8b0-f3cf-477a-a74b-8c27ca9504ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147174 Jan 19 16:47:25.601113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1101/1794] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:26.135234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:26.135867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:26.142529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:26.142976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:26.143778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:26.144217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:26.274428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:26.282114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-414c2738-1794-4c3e-9b18-5d0898fd1040 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150576 Jan 19 16:47:26.282679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1102/1795] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:26 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:26.618667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:26.619153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:26.625690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:26.626148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:26.626926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:26.627364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:26.753426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:26.761175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-12321bf2-eca0-4764-9b7c-6da1b1f212ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146391 Jan 19 16:47:26.761735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1103/1796] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:27.300081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:27.300739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:27.306897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:27.307343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:27.308144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:27.308580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:27.438929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:27.446673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fab4ec4d-a5de-464c-a869-a84cfb3d8b77 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150853 Jan 19 16:47:27.447236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1104/1797] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:27 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:27.778027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:27.778675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:27.784588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:27.785046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:27.785846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:27.786291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:27.911026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:27.919187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-926fc868-d8d8-419e-bffe-fee38216cb3e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144737 Jan 19 16:47:27.919710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1105/1798] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:28.463752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:28.464371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:28.471075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:28.471526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:28.472336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:28.472805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:28.601860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:28.610118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-478d772c-d2e1-4414-8870-07b56e55d9b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149477 Jan 19 16:47:28.610681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1106/1799] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:28 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:28.936061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:28.936704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:28.942504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:28.942957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:28.943748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:28.944191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:29.071316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:29.079602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fa975577-f5af-4d5b-b4e1-9aa1a1037c6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147199 Jan 19 16:47:29.080192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1107/1800] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:29.626871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:29.627540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:29.633904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:29.634356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:29.635167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:29.635605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:29.763748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:29.771478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a4c8dd83-421e-4261-a820-ee2f136525b2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148478 Jan 19 16:47:29.772256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1108/1801] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:29 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:30.096604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:30.097208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:30.102854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:30.103302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:30.104091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:30.104521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:30.232568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:30.240743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-021f2afc-8fd3-4bae-afef-3935868a74e5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148221 Jan 19 16:47:30.241298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1109/1802] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:30.788152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:30.788748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:30.795126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:30.795581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:30.796389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:30.797418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:30.927241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:30.936266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9f0ce4dc-0000-4d64-aa3a-96b01c9bff8e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151834 Jan 19 16:47:30.936840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1110/1803] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:30 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:31.258233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:31.259004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:31.266125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:31.266572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:31.267344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:31.268008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:31.404741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:31.413234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d364981f-9b80-4453-a76c-338f87073f01 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.159184 Jan 19 16:47:31.413804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1111/1804] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:31.952804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:31.953449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:31.959635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:31.960111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:31.960876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:31.961305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:32.092094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:32.099827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bc87a0f4-442e-4436-8880-9692940bdda0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150643 Jan 19 16:47:32.100388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1112/1805] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:31 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:32.430015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:32.430619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:32.436440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:32.436885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:32.437644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:32.438072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:32.562173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:32.569799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d6c895fe-45d7-4ada-ab3e-35183f2530f9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.143338 Jan 19 16:47:32.570357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1113/1806] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:33.115498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:33.116152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:33.122417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:33.122876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:33.123653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:33.124123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:33.257355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:33.265161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d05e8b71-b9b4-4f33-9396-8abbb7cfc098 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153362 Jan 19 16:47:33.266322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1114/1807] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:33 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:33.586069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:33.586677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:33.592508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:33.592958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:33.593733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:33.594193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:33.719001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:33.726682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e3654ebe-6e1c-4ccd-ab1e-299e9898668f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144287 Jan 19 16:47:33.727241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1115/1808] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:34.282328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:34.282919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:34.289081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:34.289532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:34.290301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:34.290993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:34.420160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:34.428122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-39483d4a-5b76-4d9a-83ec-4867034c04e2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149898 Jan 19 16:47:34.428696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1116/1809] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:34 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:47:34.744681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:34.745304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:34.751696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:34.752164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:34.752940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:34.753380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:34.878613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:34.886643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-770493da-1dba-44c8-acc1-fc1e245eef38 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145612 Jan 19 16:47:34.887206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1117/1810] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:35.444490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:35.445174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:35.451315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:35.451802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:35.452574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:35.453009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:35.585202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:35.592971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-04287b02-ad0b-4c02-8e05-eca917ac9324 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152154 Jan 19 16:47:35.593538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1118/1811] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:35 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:35.903523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:35.904118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:35.909981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:35.910433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:35.911189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:35.911618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:36.038536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:36.046510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8690323a-0d46-4c3f-bc98-d3248b96bcf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146671 Jan 19 16:47:36.047076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1119/1812] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:36.609490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:36.610136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:36.616938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:36.617392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:36.618159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:36.618596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:36.746587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:36.754820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c8c2640d-0a6a-41a3-b1a2-3169d0590031 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149043 Jan 19 16:47:36.755390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1120/1813] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:36 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:37.065933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:37.066571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:37.072422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:37.072878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:37.073646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:37.074077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:37.203209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:37.210985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5b0ecd72-33fd-4c54-b512-cbd03f5b5b46 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149255 Jan 19 16:47:37.211554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1121/1814] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:37.771104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:37.771784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:37.778123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:37.778577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:37.779357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:37.779831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:37.906058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:37.914296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-85a74c65-703d-42c1-8f48-73fa188ac598 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146958 Jan 19 16:47:37.914861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1122/1815] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:37 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:38.227789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:38.228402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:38.234219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:38.234670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:38.235440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:38.235944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:38.362527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:38.370211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-076d0505-ef26-43b6-aaaa-143e0b7fcb41 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146063 Jan 19 16:47:38.370784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1123/1816] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:38.930888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:38.931505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:38.937887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:38.938276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:38.939659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:38.940120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:39.064913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:39.073021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bb8987fa-1284-4e4b-8d8c-e6d28a810f20 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145755 Jan 19 16:47:39.073586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1124/1817] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:38 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:39.386617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:39.387222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:39.393801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:39.394260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:39.395044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:39.395488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:39.530236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:39.538635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c75d8034-d2d4-4248-bc0c-9e3ae350440e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.155558 Jan 19 16:47:39.539195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1125/1818] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:40.090245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:40.090933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:40.097247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:40.097700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:40.098479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:40.098924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:40.227619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:40.235916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0ca558cb-d17a-4eaa-9e95-84ddfe12fe25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148854 Jan 19 16:47:40.236484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1126/1819] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:40 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:40.555465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:40.555867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:40.561604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:40.562197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:40.562841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:40.563808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:40.687814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:40.695956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-52170252-863e-41c3-8d6e-868777a981c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144237 Jan 19 16:47:40.696520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1127/1820] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:41.252900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:41.253656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:41.259964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:41.260422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:41.261314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:41.261628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:41.390837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:41.398434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1784b939-907a-44f0-bc7c-e92b7963bb13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149207 Jan 19 16:47:41.399018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1128/1821] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:41 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:41.713208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:41.713828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:41.720351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:41.720809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:41.721584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:41.722027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:41.847238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:41.854955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5c6aa169-e0f2-48b2-82e8-29e1d32ed40a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145362 Jan 19 16:47:41.855528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1129/1822] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:42.415252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:42.416171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:42.422358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:42.423453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:42.424262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:42.424706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:42.553840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:42.562133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9296a52-a2c6-4474-bb27-d6f4bb00a03c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150405 Jan 19 16:47:42.562637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1130/1823] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:42 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:42.871655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:42.872298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:42.878072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:42.878524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:42.879292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:42.879754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:43.003567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:43.011221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2db407c8-1335-4b5b-896f-73750dc7e17f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.143164 Jan 19 16:47:43.011807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1131/1824] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:43.579921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:43.580552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:43.586757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:43.587214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:43.588021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:43.588462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:43.718694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:43.726360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-258e6d6a-d596-46bf-bb05-833350841eed tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150682 Jan 19 16:47:43.726944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1132/1825] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:43 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:44.027030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:44.027695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:44.033498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:44.033955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:44.034730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:44.035169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:44.395433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:44.403344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-11d38e8d-6809-42aa-bcb6-7b04db4085c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.379970 Jan 19 16:47:44.403947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1133/1826] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:44.741958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:44.742767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:44.749464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:44.749957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:44.750786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:44.751228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:44.962400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:44.970092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-19de45c1-c572-4b63-9e77-659701f3d80a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.231736 Jan 19 16:47:44.970652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1134/1827] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:44 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:45.420297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:45.420821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:45.427640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:45.428123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:45.428898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:45.429340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:45.562326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:45.570926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e528de01-05d4-4308-9178-614a63893a5e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.154377 Jan 19 16:47:45.571515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1135/1828] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:45.987185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:45.987994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:45.993856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:45.994388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:45.995246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:45.995815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:46.126945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:46.134701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9b0c642c-e2bf-482b-838e-415bb40cbd30 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151840 Jan 19 16:47:46.135265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1136/1829] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:45 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:46.588235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:46.588850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:46.595237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:46.595700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:46.596487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:46.596929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:46.723944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:46.731562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-70ce88a9-fee4-49cf-b07a-91435976a155 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147264 Jan 19 16:47:46.732155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1137/1830] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:47.151550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:47.152172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:47.158593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:47.159058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:47.159923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:47.160374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:47.296223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:47.303823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-619df6fa-3e39-4dd3-9665-b8036211b4c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.155930 Jan 19 16:47:47.304383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1138/1831] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:47 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:47.748188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:47.748804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:47.755657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:47.756139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:47.756911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:47.757346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:47.889925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:47.897710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79629ff4-0c63-4af7-8468-31706b40f2f2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.153206 Jan 19 16:47:47.898259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1139/1832] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:48.320239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:48.320900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:48.326737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:48.327191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:48.327988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:48.328434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:48.457647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:48.465354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3e5ddf91-65d6-4b0c-92b4-f798c70b2c12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148736 Jan 19 16:47:48.465922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1140/1833] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:48 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:48.913911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:48.914522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:48.921197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:48.921826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:48.923027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:48.923472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:49.050252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:49.057997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-07185f07-92fd-44f2-b4f9-7f3b74350204 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147690 Jan 19 16:47:49.058539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1141/1834] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:49.482323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:49.483597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:49.490627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:49.491084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:49.491903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:49.492348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:49.626073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:49.634015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8aa7693e-8a24-4325-8420-cda82cdc3a4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.155440 Jan 19 16:47:49.634585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1142/1835] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:49 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:50.074937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:50.075548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:50.081761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:50.082219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:50.082993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:50.083425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:50.215526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:50.223853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ddda936-8492-42eb-b5e3-130a1408b302 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152445 Jan 19 16:47:50.224417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1143/1836] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:50.650075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:50.650705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:50.656595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:50.657663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:50.658419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:50.658851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:50.785023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:50.793104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-037a0cf9-8986-4a48-860c-b597a1b9d05a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146615 Jan 19 16:47:50.793680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1144/1837] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:50 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:51.240181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:51.240791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:51.247017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:51.247467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:51.248269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:51.248707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:51.378481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:51.386171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ae53f0f6-fce1-4d8e-9fbb-29b8439d6931 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149803 Jan 19 16:47:51.386721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1145/1838] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:51.809206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:51.809934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:51.816237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:51.816692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:51.817466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:51.818004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:51.945519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:51.953253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0103a318-f286-40da-9270-3f84cca1eeeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147655 Jan 19 16:47:51.953866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1146/1839] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:51 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:52.402703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:52.403248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:52.409474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:52.409925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:52.410690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:52.411130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:52.540240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:52.548752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-90cfbfac-8bc4-42ee-b09c-e1daff275ab5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149727 Jan 19 16:47:52.549314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1147/1840] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:52.970524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:52.971134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:52.977044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:52.977496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:52.978274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:52.978697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:53.105284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:53.113174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1911a5cb-89d5-4a92-a4da-b7a0ad585329 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146831 Jan 19 16:47:53.120164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1148/1841] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:52 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:53.567138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:53.567695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:53.574105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:53.574558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:53.575334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:53.575817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:53.703634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:53.711382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-641b21f2-76e5-4507-aa1c-8ce1247b97d4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148483 Jan 19 16:47:53.711978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1149/1842] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:54.130407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:54.131188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:54.136993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:54.137440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:54.138203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:54.138636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:54.270216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:54.278024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2429006a-674a-47fb-bff5-fcbad608b850 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151184 Jan 19 16:47:54.278601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1150/1843] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:54 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:54.727281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:54.727920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:54.734306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:54.734744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:54.736124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:54.736564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:54.864754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:54.872954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-645e9ad2-ef4b-4003-967c-134435f2629a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149376 Jan 19 16:47:54.873527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1151/1844] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:55.294980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:55.295644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:55.301524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:55.301970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:55.302727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:55.303157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:55.431958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:55.440200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4dcb4417-b544-45f9-8a46-f1c6a4eb0e92 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149247 Jan 19 16:47:55.440766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1152/1845] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:55 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:55.890070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:55.890677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:55.897020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:55.897469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:55.898233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:55.898667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:56.027945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:56.035637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-907873d0-b98a-4396-8633-0793a6ac89f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149481 Jan 19 16:47:56.036222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1153/1846] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:56.457423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:56.458079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:56.463827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:56.464280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:56.465049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:56.465482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:56.604767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:56.612568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2af33c8a-66ba-44f9-9390-41d3a1265e6b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.158746 Jan 19 16:47:56.613132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1154/1847] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:56 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:57.052520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:57.053128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:57.059336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:57.059820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:57.060593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:57.061032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:57.186726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:57.201150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-014bd227-17c2-4593-ae91-9e2685bf7ec1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152260 Jan 19 16:47:57.201729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1155/1848] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:57.829945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:57.830570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:57.836410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:57.836867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:57.837646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:57.838088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:57.965189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:57.973413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-177afb3c-1bc6-4707-b977-03bd0f93ab8d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.347947 Jan 19 16:47:57.973978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1156/1849] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:57 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:58.218694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:58.220038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:58.227178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:58.227641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:58.228451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:58.228896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:58.362479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:58.370194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8a1d4a27-845d-4290-ab89-6d271b11d28e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.155232 Jan 19 16:47:58.370755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1157/1850] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:58.990521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:58.991149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:58.996993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:58.997442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:58.998203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:58.998635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:59.126143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:59.133868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a0b2b0af-a113-4f11-8ea2-084f23150eb4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146951 Jan 19 16:47:59.134431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1158/1851] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:58 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:47:59.385840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:47:59.386453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:47:59.392789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:59.393240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:59.394015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:47:59.394454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:47:59.526168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:47:59.534503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ab1f29c2-57ba-4a41-98f8-ca126ed40796 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152162 Jan 19 16:47:59.535088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1159/1852] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:47:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:00.150298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:00.150948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:00.157298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:00.157743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:00.158508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:00.158941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:00.286514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:00.294489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-370c11e3-d812-4ecb-8049-aa8c91aa387d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147809 Jan 19 16:48:00.295064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1160/1853] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:00 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:00.555134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:00.556296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:00.563703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:00.564168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:00.565001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:00.565403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:00.693538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:00.701230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ca9bed9b-b1c9-41f4-af04-6dec15d679f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150058 Jan 19 16:48:00.701799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1161/1854] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:01.311636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:01.312322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:01.318845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:01.319302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:01.320136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:01.320583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:01.453317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:01.460343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-54e8cc30-d3ea-4b70-a192-0b11d63cbf4f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152340 Jan 19 16:48:01.460907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1162/1855] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:01 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:01.717941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:01.718551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:01.725331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:01.725780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:01.726549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:01.726985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:01.852661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:01.860451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4ff0779a-1570-422d-8e67-3e309f2acd06 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146125 Jan 19 16:48:01.860987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1163/1856] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:01 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:02.477223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:02.477840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:02.483692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:02.484161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:02.484938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:02.485380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:02.616932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:02.624632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f329ac8c-3b8c-4ad4-8f64-a68efd87976e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151003 Jan 19 16:48:02.625202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1164/1857] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:02 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:02.877341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:02.877883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:02.884222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:02.884673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:02.885441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:02.885877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:03.012442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:03.020078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-93f0cfdc-3bcc-45b7-a31f-e56f8684ec97 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146997 Jan 19 16:48:03.020643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1165/1858] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:03.640869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:03.641982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:03.647872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:03.648333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:03.649114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:03.649560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:03.778755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:03.786974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b03006b-3f8e-45ea-bf3c-2c808ecb11ab tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149754 Jan 19 16:48:03.787533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1166/1859] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:03 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:04.037492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:04.038024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:04.044821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:04.045268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:04.046035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:04.046471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:04.173469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:04.181354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-64fa7518-9bc1-491f-b13d-0b6d87a0a08a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147582 Jan 19 16:48:04.181944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1167/1860] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:04.804148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:04.804734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:04.810538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:04.810999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:04.811777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:04.812213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:04.939570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:04.947309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9e7ec04-1a28-4940-91e9-b2e98e222ab6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146763 Jan 19 16:48:04.947906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1168/1861] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:04 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:48:05.198076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:05.198712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:05.204907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:05.205352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:05.206118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:05.206547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:05.336363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:05.343983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6a3db50d-f027-46b1-a2fe-92edc12b6f2a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149625 Jan 19 16:48:05.345050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1169/1862] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:05.963764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:05.964412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:05.970098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:05.970547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:05.971306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:05.971767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:06.098850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:06.106582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a2bfa02-f8bb-4250-88eb-166830c85405 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146387 Jan 19 16:48:06.107155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1170/1863] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:05 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:06.362538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:06.363246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:06.369395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:06.369854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:06.370640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:06.371353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:06.507430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:06.515633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c76899c-c73f-4444-aba4-5a55a34c6257 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.158227 Jan 19 16:48:06.516237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1171/1864] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:07.123340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:07.124032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:07.130502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:07.130958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:07.131771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:07.132215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:07.260298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:07.267956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a45e32e3-ff96-48cf-9978-1a3a3cd5e74f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148286 Jan 19 16:48:07.268522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1172/1865] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:07 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:07.532552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:07.533090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:07.539321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:07.539802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:07.540826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:07.541263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:07.664892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:07.673481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-514c729f-341c-40ca-ab6d-b23a5e410d3a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145095 Jan 19 16:48:07.674042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1173/1866] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:08.284472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:08.285109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:08.291150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:08.291597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:08.292399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:08.292833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:08.420434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:08.428058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5478d6f0-8fb9-473d-ac9c-86aaacb7caeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147143 Jan 19 16:48:08.428618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1174/1867] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:08 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:08.691131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:08.691777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:08.697977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:08.698423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:08.699185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:08.699610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:08.827190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:08.835054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3228cf07-6bc6-4577-8966-a3bae3c7e73b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148179 Jan 19 16:48:08.835614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1175/1868] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:09.444692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:09.445376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:09.451318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:09.451811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:09.452590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:09.453031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:09.582850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:09.590528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c471b62-a854-4901-ac4d-fdbf7d6e234e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149470 Jan 19 16:48:09.591097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1176/1869] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:09 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:09.851496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:09.852151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:09.858438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:09.858893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:09.860345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:09.860792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:09.987121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:09.995280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-14b7cbd3-f2da-4d20-9231-10e39acee2a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147426 Jan 19 16:48:09.996193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1177/1870] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:10.606973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:10.607571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:10.613335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:10.613785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:10.614542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:10.614983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:10.744651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:10.752790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-756b682a-0b33-4ff9-81d2-d2c9ba8fa029 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149459 Jan 19 16:48:10.753357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1178/1871] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:10 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:11.012275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:11.012887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:11.019030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:11.019482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:11.020289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:11.020721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:11.144907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:11.152546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3ae3e748-5f5b-42d3-a019-0cfd3ba12a64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.143851 Jan 19 16:48:11.153113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1179/1872] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:48:11.769566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:11.770182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:11.776071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:11.776523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:11.777329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:11.777768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:11.905037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:11.913405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-82906b2b-bd29-4019-91d4-a6d71abc712f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148000 Jan 19 16:48:11.913971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1180/1873] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:11 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:12.169495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:12.170049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:12.176318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:12.176771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:12.177554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:12.177991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:12.309653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:12.317844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a21b918c-c10b-4415-b52c-0cb8dab8691e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152246 Jan 19 16:48:12.318411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1181/1874] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:12.931139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:12.931908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:12.937761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:12.938215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:12.938992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:12.939431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:13.065881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:13.073575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff8c55ef-cd51-45e8-a769-29716c227247 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146897 Jan 19 16:48:13.074146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1182/1875] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:12 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:13.334368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:13.334979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:13.341234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:13.341686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:13.342456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:13.342894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:13.471660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:13.479401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d4cd2984-bf71-4bb9-819b-2da301e03432 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148628 Jan 19 16:48:13.480033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1183/1876] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:14.090569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:14.091205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:14.096999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:14.097444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:14.098204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:14.098636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:14.224604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:14.232313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fe7cdb44-7990-4095-a863-531773c9df23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145423 Jan 19 16:48:14.232885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1184/1877] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:14 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:14.496470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:14.497006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:14.502876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:14.503323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:14.504148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:14.504584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:14.628766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:14.636365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff7fab50-1569-4503-8449-7d0fd0cb3ae9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.143672 Jan 19 16:48:14.636926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1185/1878] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:15.249497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:15.250076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:15.257639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:15.258087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:15.258859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:15.259296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:15.389026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:15.396857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff61c1f3-7617-42a7-8a50-764df75b654c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150966 Jan 19 16:48:15.397435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1186/1879] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:15 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:15.653697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:15.654233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:15.660082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:15.660537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:15.661305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:15.661742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:15.789272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:15.798080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-21fed2fc-8666-4ad4-8337-baa47bf1e860 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147409 Jan 19 16:48:15.798636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1187/1880] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:16.413482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:16.414159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:16.420499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:16.420950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:16.421710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:16.422163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:16.554707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:16.562523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7172167-d85f-4b77-9b05-26bc1d3732e7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152709 Jan 19 16:48:16.563632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1188/1881] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:16 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:16.814544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:16.815264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:16.820978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:16.821428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:16.822212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:16.822620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:16.955064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:16.962779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bfcdb5ea-675d-4513-9700-737149e8818e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.152499 Jan 19 16:48:16.963339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1189/1882] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:17.583149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:17.583808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:17.590013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:17.590460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:17.591228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:17.591667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:17.721884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:17.729645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1db63a96-b653-4d93-a395-68a21bd5cd6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150265 Jan 19 16:48:17.730250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1190/1883] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:17 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:17.978742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:17.979354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:17.985318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:17.985775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:17.986547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:17.986991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:18.111108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:18.118774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e371a294-7440-4f21-bd3a-0f2e648e0925 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.143636 Jan 19 16:48:18.119340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1191/1884] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:18.746386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:18.746988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:18.753385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:18.753841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:18.754614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:18.755057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:18.883451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:18.891376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-db5c7098-7225-4033-ac5f-120e22753c96 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148731 Jan 19 16:48:18.892019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1192/1885] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:18 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:19.135122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:19.135764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:19.141526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:19.141973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:19.142734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:19.143168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:19.281689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:19.289350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-88d5e129-7f35-4623-ab23-7c6c8d691187 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.157765 Jan 19 16:48:19.289918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1193/1886] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:19.909677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:19.910302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:19.916827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:19.917280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:19.918056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:19.918498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:20.045109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:20.053257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e8145af7-a8d4-4372-894d-3b8fc83538ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147380 Jan 19 16:48:20.053825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1194/1887] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:19 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:20.305921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:20.306521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:20.312323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:20.312771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:20.313528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:20.313959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:20.441702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:20.449351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e577cfc5-16f2-4e95-adfa-bb7afd223645 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147025 Jan 19 16:48:20.449907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1195/1888] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:21.069559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:21.070158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:21.076335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:21.076779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:21.077540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:21.077970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:21.202330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:21.210504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45245983-ed5c-4217-8afe-aea1df8e7ffd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144489 Jan 19 16:48:21.211053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1196/1889] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:21 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:21.465722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:21.466342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:21.472042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:21.472542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:21.473302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:21.473742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:21.598839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:21.606520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c133df8b-1846-482a-9373-dc8c0afcb89c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144437 Jan 19 16:48:21.607088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1197/1890] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:22.232174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:22.232865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:22.239101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:22.239558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:22.240362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:22.240806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:22.377560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:22.385305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f40c093d-6900-405c-ae9e-048bace7e394 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.156752 Jan 19 16:48:22.385867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1198/1891] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:22 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:48:22.623981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:22.624535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:22.630841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:22.631299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:22.632118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:22.632560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:22.759704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:22.768157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-65851cca-d027-4042-affd-bbc577ab8854 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147841 Jan 19 16:48:22.768723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1199/1892] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:23.402104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:23.402799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:23.409605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:23.410145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:23.410817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:23.411254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:23.540912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:23.549276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ea6e42a5-283f-4813-bf20-fbcda5b93f12 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150745 Jan 19 16:48:23.549848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1200/1893] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:23 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:23.785435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:23.786054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:23.792413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:23.792871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:23.793682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:23.794121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:23.918828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:23.926702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7cf2606a-a481-4a36-8703-eb6f59bad93b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145513 Jan 19 16:48:23.927269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1201/1894] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:24.566859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:24.567540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:24.573878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:24.574324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:24.575086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:24.575517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:24.707238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:24.715230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8b8ef6ee-02b0-4774-9560-2616504982e0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153060 Jan 19 16:48:24.715876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1202/1895] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:24 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:24.943457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:24.944103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:24.950130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:24.950589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:24.951371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:24.951855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:25.075731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:25.084099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c051c6d2-e7d9-4883-96b3-4c67c61ed935 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144248 Jan 19 16:48:25.084672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1203/1896] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:25.732261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:25.732830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:25.740215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:25.740677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:25.741450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:25.741897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:25.867793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:25.875575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8b7e0b45-cec1-4396-b155-1bef275829af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146985 Jan 19 16:48:25.876173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1204/1897] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:25 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:26.101142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:26.101683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:26.107502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:26.107995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:26.108773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:26.109218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:26.237388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:26.245143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c482164f-5195-41f7-8a45-b56109903f43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148027 Jan 19 16:48:26.245707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1205/1898] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:26.891817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:26.892433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:26.898843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:26.899285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:26.900087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:26.900520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:27.028714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:27.037047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bd2d5a2e-0c3c-4ed5-b61e-d8eeb6596d8a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148801 Jan 19 16:48:27.037612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1206/1899] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:26 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:27.261830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:27.262442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:27.268258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:27.268716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:27.269496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:27.269938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:27.403006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:27.411894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-24c2c323-9576-44e4-b95d-238a70f4d179 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.153607 Jan 19 16:48:27.412474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1207/1900] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:28.053724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:28.054452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:28.060515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:28.060963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:28.061724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:28.062158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:28.192160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:28.199744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3915854f-c483-4fb4-8cab-1bb0e86b1f94 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149650 Jan 19 16:48:28.200311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1208/1901] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:28 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:28.428723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:28.429324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:28.435068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:28.435513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:28.436310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:28.436738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:28.567446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:28.575262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1276fe03-776e-4917-b026-60e630ac7154 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150173 Jan 19 16:48:28.575860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1209/1902] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:29.216227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:29.216882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:29.223592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:29.224067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:29.224829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:29.225257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:29.354460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:29.362731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e91424e6-9993-4f29-a501-30c73d946522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150121 Jan 19 16:48:29.363303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1210/1903] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:29 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:29.592995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:29.593528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:29.599427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:29.599921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:29.600694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:29.601132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:29.731293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:29.739733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c43ed9b1-007e-43f4-943a-35c3d9a72306 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150419 Jan 19 16:48:29.740253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1211/1904] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:30.379348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:30.380005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:30.386197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:30.386648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:30.387414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:30.387890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:30.523229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:30.531759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7816e9b-a65d-4662-a245-57ababeacdbb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.155448 Jan 19 16:48:30.532320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1212/1905] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:30 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:30.756621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:30.757234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:30.763011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:30.763465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:30.764257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:30.764694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:30.892010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:30.899655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d92d67bf-54a9-4cdf-b7f2-5ba582dc09a9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146700 Jan 19 16:48:30.900242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1213/1906] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:31.549506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:31.550206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:31.556359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:31.556814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:31.557585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:31.558023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:31.688277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:31.695936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f314fcd1-a20f-4b7b-9ddd-1742823337ec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150699 Jan 19 16:48:31.696437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1214/1907] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:31 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:31.916856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:31.917504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:31.923325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:31.923806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:31.924579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:31.925014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:32.050954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:32.058596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-14245f36-7783-4d63-8a3c-f695d452283b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145682 Jan 19 16:48:32.059166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1215/1908] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:32.712413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:32.713030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:32.719286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:32.719776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:32.720552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:32.720990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:32.852297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:32.860433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4921639e-d038-4436-acb4-358022ecfccf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151771 Jan 19 16:48:32.860993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1216/1909] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:32 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:33.075581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:33.076258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:33.082273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:33.082737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:33.083519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:33.084001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:33.222921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:33.230860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2dcb526f-8f26-4750-8aaf-9fff4955ca78 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.158874 Jan 19 16:48:33.231895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1217/1910] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:33.877695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:33.878374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:33.884663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:33.885119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:33.885904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:33.886346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:34.014062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:34.022511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9b4ffa4-89d8-4ad8-ad56-69ec85684866 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148994 Jan 19 16:48:34.023090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1218/1911] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:33 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:34.249701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:34.250975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:34.256899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:34.257353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:34.258131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:34.258564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:34.387442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:34.395145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-81c079a9-0234-4aa1-8650-3697280bb21f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149119 Jan 19 16:48:34.395726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1219/1912] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:35.039149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:35.039778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:35.046216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:35.046662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:35.047430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:35.047896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:35.173835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:35.181436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-57a02136-de0e-4444-854d-f1d48815c907 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145909 Jan 19 16:48:35.181993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1220/1913] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:35 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:35.411122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:35.411625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:35.417646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:35.418096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:35.418861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:35.419296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:35.545877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:35.553763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1df6fde2-e06e-4c48-8557-2f7bc32bebbb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146383 Jan 19 16:48:35.554318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1221/1914] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:36.198174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:36.198784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:36.205036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:36.205480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:36.206242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:36.206673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:36.340210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:36.348540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1bbfdf1a-c590-45fb-ae96-f5021eba95f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153905 Jan 19 16:48:36.349117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1222/1915] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:36 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:36.571220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:36.571794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:36.577651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:36.578636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:36.579459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:36.579931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:36.706727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:36.714353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c94a5a66-3d96-4541-bede-e2734463535b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146876 Jan 19 16:48:36.714902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1223/1916] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:37.365675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:37.366391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:37.372529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:37.372982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:37.373760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:37.374199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:37.507248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:37.515069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9516913-bb21-4455-bfe0-48ae8fd56cf1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153098 Jan 19 16:48:37.515639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1224/1917] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:37 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:37.729814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:37.730422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:37.736832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:37.737274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:37.738037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:37.738466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:37.863802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:37.871413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dcf3525f-b809-4189-a950-72194f3c505c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145201 Jan 19 16:48:37.872002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1225/1918] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:38.532160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:38.532817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:38.538943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:38.539387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:38.540183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:38.540909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:38.669665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:38.677517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5478a9fc-dbbf-425d-942c-042a79c4159c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149467 Jan 19 16:48:38.678094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1226/1919] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:38 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:38.887948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:38.888560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:38.894893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:38.895341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:38.896125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:38.896559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:39.021127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:39.028811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1a17f77f-ab29-4293-914f-d4cb6691799d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144491 Jan 19 16:48:39.029377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1227/1920] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:39.694111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:39.694719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:39.700993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:39.701439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:39.702197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:39.702629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:39.828974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:39.836953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-84de6fa1-d98c-46a8-aeed-2612f2c3626a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146518 Jan 19 16:48:39.837522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1228/1921] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:39 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:40.045756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:40.046405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:40.052959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:40.053416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:40.054196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:40.054640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:40.184266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:40.192808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d1bba57c-a37e-44c3-a983-3aab27a498b0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150666 Jan 19 16:48:40.193377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1229/1922] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:40.853560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:40.854178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:40.860784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:40.861238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:40.862017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:40.862460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:40.992046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:40.999698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-19b75b59-6eb7-4756-b687-95704fccbb25 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149778 Jan 19 16:48:41.000273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1230/1923] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:40 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:41.209351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:41.209967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:41.215841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:41.216300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:41.217078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:41.217521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:41.347642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:41.355449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d38499d3-8092-4026-be28-c4d5faeb9f05 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149699 Jan 19 16:48:41.356032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1231/1924] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:42.017754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:42.018395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:42.024678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:42.025130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:42.025906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:42.026347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:42.151174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:42.158916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d170203-5e83-4c4d-8052-ffdc9bdae126 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145399 Jan 19 16:48:42.159493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1232/1925] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:42 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:42.372861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:42.373503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:42.379892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:42.380345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:42.381129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:42.381569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:42.506483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:42.514179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b8f78fc3-6085-4e14-b02b-3d32a93aaf20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144990 Jan 19 16:48:42.514746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1233/1926] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:43.175266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:43.175956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:43.182281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:43.182836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:43.183619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:43.184086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:43.315520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:43.323318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a0425707-5744-40c6-8400-16b12c621dc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151651 Jan 19 16:48:43.323911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1234/1927] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:43 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:43.531164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:43.531867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:43.537742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:43.538207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:43.538985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:43.539432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:43.664550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:43.675115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e1dc6700-035e-4e01-bea3-f3931837732e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147630 Jan 19 16:48:43.675692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1235/1928] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:44.339452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:44.340105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:44.346483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:44.346936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:44.347737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:44.348186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:44.480209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:44.488773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9f8deee0-fa74-4643-8990-8864cd13e66e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153085 Jan 19 16:48:44.489339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1236/1929] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:44 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:44.692421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:44.693032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:44.699072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:44.699541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:44.700322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:44.700759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:44.827289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:44.835450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9f100c7f-a109-45d0-a026-4f3955a813df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146663 Jan 19 16:48:44.836041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1237/1930] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:45.504787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:45.505410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:45.511588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:45.512101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:45.512885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:45.513326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:45.642483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:45.650352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e6ff3ded-a255-4c85-8b3f-d9eceb5a6dc1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149740 Jan 19 16:48:45.650925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1238/1931] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:45 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:48:45.852715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:45.853263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:45.859127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:45.859585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:45.860992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:45.861436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:45.987420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:45.995171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-33b5dfc8-03a0-4327-9b80-86fba4726172 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146139 Jan 19 16:48:45.995752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1239/1932] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:46.667003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:46.667727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:46.673977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:46.674427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:46.675197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:46.675633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:47.142706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:47.151212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dcf06045-a41a-449a-a475-387105895f70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.488091 Jan 19 16:48:47.152006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1240/1933] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:46 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:47.166001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:47.166616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:47.175368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:47.175368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:47.175658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:47.175926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:47.426361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:47.434338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-98ec9d52-c32d-48e5-a564-3c09bf76aed9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.272054 Jan 19 16:48:47.435066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1241/1934] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:48:48.169336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:48.170198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:48.176293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:48.176742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:48.177549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:48.178090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:48.304747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:48.312305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-568e9a25-cb22-40bc-bb12-a762c2843e9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147259 Jan 19 16:48:48.313456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1242/1935] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:48 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:48.450950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:48.452190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:48.458160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:48.458386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:48.459258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:48.459561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:48.591009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:48.598737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-518e572f-cd16-44dc-aeff-a59d8d8f8b07 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151433 Jan 19 16:48:48.599304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1243/1936] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:48:49.329764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:49.330404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:49.336671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:49.337120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:49.337888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:49.338325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:49.464689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:49.472673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d4541db3-5df4-474f-b729-4a15049b7946 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146850 Jan 19 16:48:49.473162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1244/1937] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:49 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:49.615506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:49.616170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:49.622008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:49.622453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:49.623211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:49.623644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:49.755113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:49.762884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-06f3968a-3fa6-4747-b64b-07c3914ebab6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151021 Jan 19 16:48:49.763452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1245/1938] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:50.489583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:50.490247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:50.496362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:50.496806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:50.497564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:50.497994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:50.624363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:50.632134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7a85e917-02c2-4c5f-a35c-1859de853d85 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146148 Jan 19 16:48:50.632692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1246/1939] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:50 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:50.779810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:50.780426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:50.786901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:50.787358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:50.788182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:50.788631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:50.912330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:50.920254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-36ae51bf-7bfd-434e-9bfd-dc9fe37c5a14 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144034 Jan 19 16:48:50.920822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1247/1940] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:51.648414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:51.649124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:51.655170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:51.655714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:51.657013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:51.657469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:51.787464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:51.795479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-389ba79e-443f-4193-aade-d90f80f6e4c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150684 Jan 19 16:48:51.796082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1248/1941] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:51 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:48:51.937114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:51.937657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:51.943474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:51.943966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:51.944744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:51.945188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:52.070924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:52.079087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-71e65b7f-03b5-4b88-88f7-a6d748495794 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145120 Jan 19 16:48:52.079652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1249/1942] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:52.812159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:52.813382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:52.819727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:52.820196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:52.820970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:52.821408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:52.952446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:52.960029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9bc074c0-0e1a-47d7-a4bf-a38a2cb771d4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151491 Jan 19 16:48:52.960589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1250/1943] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:52 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:53.095549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:53.096248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:53.102014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:53.102460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:53.103219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:53.103653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:53.229512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:53.237692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-adf12b6c-6bfe-4732-b662-7ae018a1663b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145607 Jan 19 16:48:53.238259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1251/1944] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:53.976588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:53.977292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:53.983819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:53.984277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:53.985057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:53.985491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:54.119027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:54.127288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d5d349f-5ad6-427d-898e-36a6268dfe56 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.154363 Jan 19 16:48:54.127894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1252/1945] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:53 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:54.254500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:54.255029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:54.260854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:54.261312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:54.262089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:54.262530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:54.387433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:54.395727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b1d83a5-b0ca-4524-91f8-c417a3e8378c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145410 Jan 19 16:48:54.396290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1253/1946] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:55.143776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:55.144426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:55.150861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:55.151321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:55.152145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:55.152588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:55.278171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:55.285923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d226a4f1-3b0e-4b77-b2ce-d52b86433bd3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145839 Jan 19 16:48:55.286473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1254/1947] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:55 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:55.412625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:55.413237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:55.419140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:55.419596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:55.420403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:55.420847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:55.551782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:55.559774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a3440bf4-1ea2-4fb9-a23e-23e7aba9cd04 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150548 Jan 19 16:48:55.560347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1255/1948] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:56.302190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:56.302826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:56.309156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:56.309610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:56.310389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:56.310831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:56.440124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:56.447862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-65d64173-5690-45b2-91a6-823a91a9414f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149258 Jan 19 16:48:56.448427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1256/1949] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:56 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:56.576698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:56.577365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:56.583097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:56.583556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:56.584357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:56.584795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:56.714504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:56.722147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c1d4619c-74df-4f61-9f10-ba7af6500a9e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149117 Jan 19 16:48:56.722712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1257/1950] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:57.465510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:57.466129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:57.472935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:57.473377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:57.474171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:57.474607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:57.602741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:57.610640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ebe283a-a433-4e82-b53d-0c48ff884f4b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148746 Jan 19 16:48:57.611073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1258/1951] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:57 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:57.738820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:57.739571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:57.745467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:57.745921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:57.746693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:57.747139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:57.877034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:57.894068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4aec2cc8-461d-40bf-82ec-fb14c99550ed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149792 Jan 19 16:48:57.894068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1259/1952] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:58.626994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:58.627598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:58.634841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:58.636202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:58.636991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:58.637883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:58.768908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:58.776565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-94abf20c-aa06-41e2-9047-25733465d4e3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153181 Jan 19 16:48:58.777130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1260/1953] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:58 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:58.902350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:58.903007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:58.909352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:58.909811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:58.910591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:58.911034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:59.045751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:59.053612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2f189e35-217a-4a5a-b67a-0e6469e79622 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.154726 Jan 19 16:48:59.054173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1261/1954] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:48:59.793557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:48:59.794182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:48:59.800974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:59.801424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:59.802197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:48:59.802637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:48:59.931977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:48:59.939891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-583a3491-0386-4bf0-9775-9511ecc20a7a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150198 Jan 19 16:48:59.940476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1262/1955] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:48:59 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:00.070073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:00.070688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:00.076467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:00.076921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:00.077690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:00.078126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:00.205035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:00.212749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b890f93f-2f76-4f00-8182-ea32cc2321a7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146275 Jan 19 16:49:00.213318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1263/1956] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:00.957055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:00.957674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:00.964108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:00.964566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:00.965352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:00.965794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:01.098151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:01.105796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c4ede36-c3d3-4d0d-89c8-e36dd38248d6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152544 Jan 19 16:49:01.106365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1264/1957] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:00 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:01.229353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:01.229969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:01.235610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:01.236096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:01.236862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:01.237297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:01.362747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:01.370405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e447d868-6ae1-4336-848a-35271cd5465e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144569 Jan 19 16:49:01.370997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1265/1958] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:01 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:02.121830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:02.122447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:02.129322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:02.129776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:02.130545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:02.130990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:02.263507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:02.271299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8cb0ece3-8772-44d2-a80a-8cf523fe574a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153041 Jan 19 16:49:02.271885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1266/1959] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:02 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:02.387428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:02.387982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:02.393459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:02.393905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:02.394678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:02.395148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:02.532160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:02.539872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-043a3ce4-637d-4bc0-a7f1-3d6a5490bd64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.155828 Jan 19 16:49:02.540435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1267/1960] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:03.288116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:03.288738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:03.295247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:03.295811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:03.296595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:03.297138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:03.424175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:03.431877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-826b06f4-1141-4e5d-a4d6-9c5036d3811e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147365 Jan 19 16:49:03.432449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1268/1961] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:03 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:03.557440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:03.557976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:03.563977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:03.564439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:03.565251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:03.565692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:03.695889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:03.704310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ca148109-d09c-44bf-a6b8-94c7c8fa40e9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149984 Jan 19 16:49:03.704880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1269/1962] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:04.448372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:04.449024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:04.459366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:04.459872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:04.460657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:04.461097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:04.587816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:04.596000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d489d3f1-ca88-4022-acc1-f24b469d96a7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151231 Jan 19 16:49:04.596597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1270/1963] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:04 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:04.721596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:04.722151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:04.727953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:04.728407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:04.729178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:04.729615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:04.860966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:04.868635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a5eab735-7ab1-42d7-b181-9747870298e2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151114 Jan 19 16:49:04.869207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1271/1964] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:05.612156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:05.612856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:05.618972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:05.619425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:05.620227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:05.620669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:05.749949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:05.758312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ce6d9826-c727-4b4a-a7e9-f24bf0792d67 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150432 Jan 19 16:49:05.758882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1272/1965] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:05 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:05.885155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:05.885702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:05.891334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:05.891821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:05.892599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:05.893044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:06.020464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:06.028425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-29d5e6a9-abe2-4482-825b-1340bada4fa3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146697 Jan 19 16:49:06.029004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1273/1966] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:06.774877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:06.775475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:06.782008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:06.782459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:06.783226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:06.783660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:06.913349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:06.921258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3df5b1fb-0d92-46b4-903b-72e09729cbeb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150096 Jan 19 16:49:06.921822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1274/1967] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:06 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:07.045792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:07.046401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:07.052978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:07.053453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:07.054222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:07.054684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:07.180154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:07.188471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9e0fe7f7-d065-4474-b8f5-4a8281444d0a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145643 Jan 19 16:49:07.189044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1275/1968] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:07.938694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:07.939302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:07.945536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:07.945988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:07.946761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:07.947196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:08.077311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:08.085146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6c2746ad-0177-45a9-ab22-1d6b8f92b865 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150791 Jan 19 16:49:08.085710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1276/1969] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:07 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:08.205156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:08.205790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:08.211372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:08.211857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:08.212620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:08.213052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:08.339098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:08.350238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c363d89c-fba6-4a16-a53b-f7f28b9705db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148539 Jan 19 16:49:08.350801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1277/1970] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:09.101592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:09.102201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:09.108387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:09.108837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:09.109599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:09.110034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:09.235305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:09.242967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-16b5eaa1-4ed9-4435-84a2-c7b1196b31c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144971 Jan 19 16:49:09.243526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1278/1971] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:09 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:09.367349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:09.367986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:09.373666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:09.374122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:09.374897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:09.375983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:09.507754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:09.515429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-11bfaa9e-fab2-40da-90ae-577c6b27cb65 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151641 Jan 19 16:49:09.516032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1279/1972] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:10.259894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:10.260515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:10.266678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:10.267122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:10.267916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:10.268349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:10.394132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:10.401972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b2210112-0c94-414e-99f9-e5f091eebf9b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145728 Jan 19 16:49:10.402547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1280/1973] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:10 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:10.532226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:10.532842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:10.538717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:10.539166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:10.539967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:10.540410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:10.676136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:10.683906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7425b5b8-fd6a-467d-85ad-25a79a9ebac3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.155337 Jan 19 16:49:10.684474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1281/1974] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:11.419365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:11.420009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:11.426849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:11.427301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:11.428105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:11.428542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:11.560196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:11.568124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9bcc6c23-0044-43b3-98d5-f2e26ed5f535 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152571 Jan 19 16:49:11.568683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1282/1975] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:11 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:11.701137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:11.701747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:11.708167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:11.708561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:11.709326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:11.709764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:11.840775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:11.849064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a773cca7-a9c0-4fea-bda0-6b66f060901c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151503 Jan 19 16:49:11.849636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1283/1976] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:12.584964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:12.585566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:12.591836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:12.592288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:12.593069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:12.593505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:12.724958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:12.732645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2880a201-cc8a-4ae4-9700-d752f6c9db64 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151336 Jan 19 16:49:12.733201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1284/1977] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:12 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:12.865672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:12.866273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:12.872129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:12.872592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:12.873340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:12.873773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:12.998608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:13.006753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dd19841d-7e34-430f-952d-dcbc8701b855 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144624 Jan 19 16:49:13.007254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1285/1978] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:13.749223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:13.750365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:13.756550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:13.757000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:13.757765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:13.758310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:13.887210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:13.894904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c160ef20-4017-45f1-82c6-d617dc4a4246 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149357 Jan 19 16:49:13.895461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1286/1979] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:13 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:14.023920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:14.024534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:14.030243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:14.030703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:14.031504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:14.031978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:14.157477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:14.165345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ae28f2c-30b2-417c-8419-79b80b9763c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144999 Jan 19 16:49:14.166179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1287/1980] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:14.911851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:14.912531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:14.918717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:14.919170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:14.919985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:14.920422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:15.052665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:15.060366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f9538ccc-c7fd-49f1-9b5a-c07be7cfb9a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152155 Jan 19 16:49:15.060935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1288/1981] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:14 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:15.182713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:15.183331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:15.189228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:15.189689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:15.190464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:15.190915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:15.316786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:15.324552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2443df3e-7ba6-4d9b-a957-de093b787284 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145362 Jan 19 16:49:15.325126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1289/1982] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:16.077084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:16.077760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:16.084474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:16.084933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:16.085710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:16.086151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:16.212006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:16.220456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-727858e2-8402-477c-a44e-e17a8327af74 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147033 Jan 19 16:49:16.221030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1290/1983] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:16 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:49:16.341407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:16.341948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:16.348149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:16.348609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:16.349385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:16.349827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:16.481192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:16.488892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e6aa1642-a4d8-4a9e-a73c-e723e6d33a8d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.150947 Jan 19 16:49:16.489454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1291/1984] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:17.238491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:17.239538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:17.246979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:17.247435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:17.248278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:17.248721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:17.379272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:17.387400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7463781a-dbe1-4815-9936-f442699db8ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153674 Jan 19 16:49:17.388007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1292/1985] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:17 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:17.506224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:17.506776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:17.512709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:17.513163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:17.513931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:17.514370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:17.644068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:17.651909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9ab0c1ea-a6bd-4ffb-ac4a-da46a4b31628 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149290 Jan 19 16:49:17.652474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1293/1986] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:18.403820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:18.404468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:18.410722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:18.411176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:18.411981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:18.412419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:18.541466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:18.551564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-85cf3b1a-cf15-4ca7-aafb-cae618f5b554 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151011 Jan 19 16:49:18.552615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1294/1987] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:18 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:18.669106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:18.669647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:18.676201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:18.676657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:18.677438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:18.677885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:18.805491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:18.813244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cc4396b1-96c3-4546-b51e-3b73709d5311 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148165 Jan 19 16:49:18.813817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1295/1988] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:19.571035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:19.571654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:19.578717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:19.579178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:19.579984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:19.580421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:19.711423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:19.719123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b6719756-0ed8-4e08-9cf4-a6ce2f61efb1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151712 Jan 19 16:49:19.719699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1296/1989] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:19 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:19.829883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:19.830489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:19.836134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:19.836579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:19.837346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:19.837779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:19.963122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:19.970769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6cc7578d-a0bf-4483-83da-6ffee6d1598c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.144467 Jan 19 16:49:19.971328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1297/1990] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:20.734826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:20.735445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:20.741726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:20.742176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:20.742958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:20.743397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:20.872298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:20.880166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b7c53db9-0b50-45ab-b90c-97411f6cb397 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148936 Jan 19 16:49:20.880740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1298/1991] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:20 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:20.987491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:20.988138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:20.994023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:20.994476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:20.995254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:20.995716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:21.123181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:21.131458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-564d4b2a-1c3d-43a9-83cd-80d83319ed1b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147594 Jan 19 16:49:21.132062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1299/1992] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:21.896887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:21.897514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:21.903433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:21.903902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:21.904669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:21.905126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:22.035372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:22.043239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c9e31be3-e184-4da3-a147-4dcbf7867522 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150254 Jan 19 16:49:22.043816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1300/1993] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:21 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:22.148688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:22.149234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:22.154934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:22.155376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:22.156215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:22.157147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:22.285466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:22.296749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-80392ce8-928a-4e4c-aeb7-ab81ff67dcba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151407 Jan 19 16:49:22.297685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1301/1994] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:23.059590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:23.060212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:23.067131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:23.067588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:23.068541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:23.068988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:23.195031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:23.202732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ed7fc58-9722-4472-bca3-8b9a60bcf527 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146719 Jan 19 16:49:23.203298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1302/1995] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:23 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:23.313511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:23.314123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:23.319979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:23.320439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:23.321251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:23.321694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:23.450200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:23.457987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6a80d540-9647-4af2-97eb-8f0b0247ab1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147954 Jan 19 16:49:23.458546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1303/1996] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:24.218991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:24.219592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:24.225599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:24.226050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:24.226818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:24.227256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:24.353199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:24.361453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ea9c14b9-71e1-4f64-823f-43b506e17f69 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145899 Jan 19 16:49:24.362021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1304/1997] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:24 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:24.474323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:24.474933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:24.480765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:24.481204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:24.481977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:24.482414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:24.612661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:24.620383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e0822802-5c29-4894-acdb-f3621badbffe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.149594 Jan 19 16:49:24.620954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1305/1998] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:25.378470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:25.379110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:25.385471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:25.385916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:25.386704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:25.387136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:25.513685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:25.521309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e41744fc-c10b-4a14-aec1-e662e5e9fd86 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147036 Jan 19 16:49:25.521873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1306/1999] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:25 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:25.636657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:25.637277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:25.642919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:25.643393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:25.644188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:25.644621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:25.771365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:25.778987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45fc30b3-ea29-4e5d-a84a-1851d61f975e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145797 Jan 19 16:49:25.779548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1307/2000] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:26.139593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:49:26.140142 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:49:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:49:26.537515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:26.538122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:26.544618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:26.545065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:26.545823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:26.546252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:26.676775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:26.684667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-70c98310-f8fd-4052-b3a4-426549c472ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150724 Jan 19 16:49:26.685248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1308/2001] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:26 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:26.796376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:26.797432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:26.803198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:26.803654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:26.804452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:26.804896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:26.931751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:26.940089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-601aefd1-32d7-4ef5-8302-d4daad02e009 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147011 Jan 19 16:49:26.940824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1309/2002] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:27.701955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:27.702577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:27.709502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:27.709958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:27.710731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:27.711175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:27.841788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:27.849662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-debf0f7e-5116-45ac-bcb7-b5a46821b577 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151362 Jan 19 16:49:27.850231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1310/2003] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:27 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:27.957398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:27.958015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:27.963923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:27.964386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:27.965161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:27.965606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:28.091601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:28.099285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45840a45-a9c9-4dac-8446-866f93694c62 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145994 Jan 19 16:49:28.099882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1311/2004] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:28.407041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:49:28.407184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:49:28.866013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:28.866580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:28.873072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:28.873561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:28.874344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:28.875389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:29.006419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:29.014227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cb4c99f8-2f42-421f-9198-2c768db31454 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152024 Jan 19 16:49:29.014790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1312/2005] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:28 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:29.115789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:29.116459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:29.122212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:29.122661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:29.123430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:29.123904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:29.254150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:29.263476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-36bb8e4c-56d8-4327-ac1f-b81d9f3d6703 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151142 Jan 19 16:49:29.264095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1313/2006] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:30.030014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:30.030664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:30.037476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:30.037934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:30.038713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:30.039163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:30.165201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:30.176629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-90eac00e-738d-40b8-ae43-9f831e4baa16 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150190 Jan 19 16:49:30.177431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1314/2007] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:30 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:30.280104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:30.280850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:30.287077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:30.287532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:30.288343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:30.288947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:30.420597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:30.428479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c3145fd8-15e0-4e4f-9f83-cd14e347d3e8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151989 Jan 19 16:49:30.429044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1315/2008] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:31.193926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:31.194534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:31.200917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:31.201367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:31.202131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:31.202588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:31.330075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:31.344369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cabd4197-fc42-440a-937d-9730f690e20f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148160 Jan 19 16:49:31.344369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1316/2009] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:31 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:49:31.445153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:31.445757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:31.451937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:31.452381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:31.453149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:31.453574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:31.586300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:31.594548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45371b2d-df77-418c-bcbf-60eb5ffb9eca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.153023 Jan 19 16:49:31.595118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1317/2010] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:32.354087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:32.354733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:32.360948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:32.361401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:32.362177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:32.362614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:32.490311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:32.498095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-df58a7fd-dc05-42dd-944d-cb8badcc1604 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147578 Jan 19 16:49:32.498656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1318/2011] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:32 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:32.611974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:32.612536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:32.618353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:32.618798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:32.619556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:32.620072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:32.746163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:32.754267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-66862cfb-7ace-43cf-aa6c-af4f7a730754 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146601 Jan 19 16:49:32.754821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1319/2012] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:33.515123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:33.516300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:33.522610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:33.523081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:33.523885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:33.524328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:33.657338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:33.664982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4a039357-3590-49c2-aa64-d6bb8cc4293e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153543 Jan 19 16:49:33.665817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1320/2013] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:33 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:33.771518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:33.772172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:33.778033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:33.778490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:33.779269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:33.779739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:33.905821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:33.913550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3499cb15-8ba2-4f3e-910f-fa37854cd238 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145650 Jan 19 16:49:33.914117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1321/2014] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:34.681661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:34.682287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:34.688290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:34.688738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:34.689503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:34.689935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:34.819725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:34.827311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ca15df61-69ac-4150-bd9d-dc98abac11ea tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149227 Jan 19 16:49:34.828579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1322/2015] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:34 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:49:34.930155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:34.930768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:34.936671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:34.937127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:34.937905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:34.938345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:35.079400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:35.087521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fb4f1915-bd32-4c68-84a3-90502bdbbc6e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.161041 Jan 19 16:49:35.088118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1323/2016] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:35.845691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:35.846325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:35.852573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:35.853028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:35.853835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:35.854270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:35.982943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:35.990779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dfd74c4f-4183-4ba9-b4f7-7fa20e521edd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149675 Jan 19 16:49:35.991418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1324/2017] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:35 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:36.105740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:36.106288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:36.111970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:36.112424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:36.113193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:36.113631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:36.237438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:36.245120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d1d33bcc-45e0-4eb0-87a6-1a2333d7d3ce tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.142895 Jan 19 16:49:36.245684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1325/2018] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:37.007965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:37.008575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:37.014850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:37.015874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:37.016654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:37.017094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:37.141604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:37.149616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9d59ab1d-358c-4a5a-96ae-0dc8511f643a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145697 Jan 19 16:49:37.150181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1326/2019] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:37 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:37.261720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:37.262625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:37.269279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:37.269735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:37.270521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:37.270965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:37.401802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:37.410111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b8d60ed-f712-406d-b2a5-10e75cc54a12 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151895 Jan 19 16:49:37.410673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1327/2020] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:38.166835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:38.167494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:38.174360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:38.174816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:38.175587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:38.176059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:38.300902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:38.308525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9deac51a-a584-4fb3-8761-9a7cb7e6f7dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145650 Jan 19 16:49:38.309099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1328/2021] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:38 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:38.426584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:38.427120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:38.432953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:38.433412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:38.434190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:38.434633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:38.561595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:38.569322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9c6db2bd-ca4f-4015-8d3f-7c5f6f7d28a4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146364 Jan 19 16:49:38.569891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1329/2022] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:39.324952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:39.325605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:39.331750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:39.332197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:39.332964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:39.333399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:39.460898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:39.469156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-13d51637-f07b-4d72-bd44-f9d1841ec7cd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147881 Jan 19 16:49:39.469733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1330/2023] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:39 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:39.586046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:39.586594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:39.592475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:39.592935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:39.593717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:39.594159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:39.722286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:39.729777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-995c7255-6774-4e22-85b0-01ae3d45b3c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147416 Jan 19 16:49:39.730337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1331/2024] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:40.485775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:40.486410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:40.492612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:40.493055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:40.493822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:40.494254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:40.627573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:40.635354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32df4eb1-a207-4c6c-a720-7e11fc8c73f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153268 Jan 19 16:49:40.635949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1332/2025] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:40 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:40.747189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:40.748858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:40.754325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:40.754787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:40.755577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:40.756051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:40.882587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:40.890337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-55eb0d27-2e22-4759-8217-53c3b343fbc2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146802 Jan 19 16:49:40.890905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1333/2026] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:41.400164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:49:41.400343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:49:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:49:41.651840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:41.652463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:41.658645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:41.659096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:41.659908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:41.660331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:41.790168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:41.799260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-798c553b-58cb-4062-b6c3-751f4def19da tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151200 Jan 19 16:49:41.799995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1334/2027] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:41 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:41.907415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:41.907996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:41.913772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:41.914240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:41.915011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:41.915451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:42.040857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:42.049101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-865a3e4b-9ff9-4bc7-8285-53677f66be0c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145861 Jan 19 16:49:42.049668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1335/2028] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:42.816222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:42.816823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:42.823066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:42.823505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:42.824325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:42.824765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:42.955462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:42.963242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7df9c162-1b47-4e8d-80b6-e00056650025 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151142 Jan 19 16:49:42.963833 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1336/2029] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:42 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:43.066307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:43.066860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:43.072673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:43.073138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:43.073914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:43.074357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:43.199430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:43.207157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-93312a00-d07a-461a-a507-2562fc26be92 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145154 Jan 19 16:49:43.207740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1337/2030] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:43.979536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:43.980183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:43.986307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:43.986807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:43.987533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:43.988061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:44.114977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:44.122633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6b184d9-da0e-41d1-921b-4034b64a2479 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146680 Jan 19 16:49:44.123196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1338/2031] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:43 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:44.224264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:44.224866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:44.230622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:44.231069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:44.231867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:44.232297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:44.361414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:44.369119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d0ec5455-8759-4673-aded-a9b6aa7bc494 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148572 Jan 19 16:49:44.369621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1339/2032] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:45.138815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:45.139438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:45.145304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:45.145757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:45.146580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:45.146974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:45.277941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:45.286316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d89e9214-1d0a-4663-96e5-3408778a4be4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151114 Jan 19 16:49:45.286875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1340/2033] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:45 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:45.385530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:45.386138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:45.392234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:45.392697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:45.393473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:45.393913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:45.527364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:45.535642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b01f33e5-7ce3-415a-a980-e9f5df857709 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.153470 Jan 19 16:49:45.536224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1341/2034] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:46.303248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:46.303908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:46.310042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:46.310487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:46.311252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:46.311702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:46.437053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:46.444669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a36ca96d-17e4-4a2c-b91e-3bb4fd7e55b1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144979 Jan 19 16:49:46.445223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1342/2035] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:46 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:46.552522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:46.553137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:46.559030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:46.559423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:46.560228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:46.560668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:46.692361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:46.700215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-11e74bea-ec1c-4b56-a4cf-4e43b603f7a6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151134 Jan 19 16:49:46.700783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1343/2036] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:47.460903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:47.461531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:47.467868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:47.468324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:47.470083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:47.470529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:47.598829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:47.606572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-85d211e2-a7f9-48d1-89b0-1eee4ec9f930 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149352 Jan 19 16:49:47.607140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1344/2037] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:47 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:47.717559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:47.718118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:47.723998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:47.724456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:47.725228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:47.725668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:47.851430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:47.859955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3ab0075-4f40-499d-8a65-459a97019f7d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145431 Jan 19 16:49:47.860743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1345/2038] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:48.623366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:48.624073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:48.633179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:48.633635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:48.634482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:48.635074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:48.766229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:48.773886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e773deb6-5652-45c2-ae8a-90393268c91b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.154231 Jan 19 16:49:48.774453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1346/2039] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:48 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:48.880647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:48.881193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:48.887243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:48.887719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:48.888497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:48.888947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:49.014314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:49.022521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ae892a1-1076-4c96-be8d-d1e6619608af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145590 Jan 19 16:49:49.023088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1347/2040] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:49.791200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:49.791850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:49.798620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:49.799075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:49.799896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:49.800339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:49.929604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:49.937899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-28a7646f-3c6b-4fbc-a07d-e321ba2068a0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150012 Jan 19 16:49:49.938418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1348/2041] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:49 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:50.039401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:50.040039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:50.045826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:50.046284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:50.047570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:50.048043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:50.174170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:50.182016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4466f88-e02e-4010-b77d-34cfcddae88d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145941 Jan 19 16:49:50.182595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1349/2042] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:50.954026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:50.954628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:50.960867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:50.961323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:50.962097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:50.962539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:51.086342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:51.094717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-660f23c0-5c65-4d43-8a5c-2a238357ec05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144439 Jan 19 16:49:51.095292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1350/2043] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:50 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:51.203079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:51.203079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:51.204494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:51.204916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:51.205727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:51.206166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:51.334129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:51.341949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4103e6cd-9644-4607-a699-6dc4bd713ec5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.147582 Jan 19 16:49:51.342510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1351/2044] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:52.075953 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:49:52.076491 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:49:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:49:52.111577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:52.112237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:52.118451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:52.118897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:52.119659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:52.120111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:52.246699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:52.254938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-da17a33f-c461-4490-bb4c-737e005e2b4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147406 Jan 19 16:49:52.255495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1352/2045] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:52 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:52.359702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:52.360325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:52.366104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:52.366536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:52.367302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:52.367767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:52.496487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:52.504340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9afa5b36-b5a9-4f00-87c6-b9d766f0020a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.148699 Jan 19 16:49:52.504905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1353/2046] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:52.571170 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:49:52.571333 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:49:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:49:53.271149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:53.271794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:53.278172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:53.278631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:53.279416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:53.279891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:53.406470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:53.414159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-55e2a7a9-9bc9-4779-9ee0-a5910c2a2410 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146583 Jan 19 16:49:53.414733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1354/2047] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:53 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:53.521579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:53.522113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:53.528309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:53.528770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:53.529554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:53.529996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:53.655179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:53.663415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3c54732c-f358-445e-b1cc-04555b170dc0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.145563 Jan 19 16:49:53.664037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1355/2048] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:54.431649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:54.432305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:54.438825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:54.439271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:54.440095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:54.440523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:54.577310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:54.585618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32f3487b-c976-437d-ab31-bf2d1b31f63d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.157558 Jan 19 16:49:54.586186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1356/2049] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:54 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:54.681010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:54.681616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:54.687981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:54.688427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:54.689188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:54.689620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:54.820619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:54.828919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-90bef9e8-9537-4c1d-9f90-112916a3fb2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.151475 Jan 19 16:49:54.829412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1357/2050] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:55.601993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:55.602605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:55.609439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:55.609912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:55.610692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:55.611139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:55.740273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:55.747933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fce4972a-0b25-4d47-813a-e093efab991d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149584 Jan 19 16:49:55.748495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1358/2051] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:55 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:55.846235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:55.846923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:55.852887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:55.853291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:55.854064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:55.854505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:55.979420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:55.988249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6a27d0d-d67f-48bc-9154-f305d959a8d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.146266 Jan 19 16:49:55.988854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1359/2052] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:56.814894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:56.815568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:56.821840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:56.822296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:56.823076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:56.823516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:56.952468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:56.960207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ef904a1d-2daa-4fa1-9bc4-245bca4955ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149720 Jan 19 16:49:56.960781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1360/2053] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:56 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:57.004389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:57.004998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:57.010790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:57.011253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:57.012096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:57.012570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:57.375613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:57.383236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f6b90a2a-77d3-4679-a142-0525c6320790 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.382277 Jan 19 16:49:57.383818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1361/2054] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:57.977497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:57.978154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:57.984473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:57.984926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:57.985698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:57.986137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:58.112465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:58.120423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c2f5fb17-7069-4fe1-88d8-365f3c08860a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146456 Jan 19 16:49:58.121152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1362/2055] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:57 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:58.400352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:58.400969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:58.407259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:58.407740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:58.408515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:58.408953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:58.555650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:58.563766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d93361e-5118-4300-a810-b44b92d8a594 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.166971 Jan 19 16:49:58.564369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1363/2056] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:59.137746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:59.138358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:59.144599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:59.145050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:59.145818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:59.146255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:59.345297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:59.353046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fe1f55d5-247e-45da-9caf-df49dfa3cd47 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.218886 Jan 19 16:49:59.353616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1364/2057] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:59 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:49:59.580523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:49:59.581359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:49:59.587457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:59.587947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:59.588767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:49:59.589210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:49:59.791341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:49:59.800403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-46cbb0d6-5583-4360-a86a-7da4bd1067ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1718 microversion: 2.1 time: 0.223538 Jan 19 16:49:59.800977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1365/2058] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:49:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1718 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:00.155628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-13a069e9-24a7-49b7-8045-867db4519370 req-a2f61ca0-d13d-479f-939c-b9ada9c91a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f71c7f-dd64-49e3-b9fe-5096584b8e66", "name": "network-vif-deleted", "tag": "ce0ade64-627f-46d5-b735-2fa587d4c9e2"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:50:00.158608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:50:00.158608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:50:00.168786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-13a069e9-24a7-49b7-8045-867db4519370 req-a2f61ca0-d13d-479f-939c-b9ada9c91a99 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:00.169240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-13a069e9-24a7-49b7-8045-867db4519370 req-a2f61ca0-d13d-479f-939c-b9ada9c91a99 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:00.182826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-13a069e9-24a7-49b7-8045-867db4519370 req-a2f61ca0-d13d-479f-939c-b9ada9c91a99 service nova] Creating event network-vif-deleted:ce0ade64-627f-46d5-b735-2fa587d4c9e2 for instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 on hv-cinder-78447 Jan 19 16:50:00.188779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-13a069e9-24a7-49b7-8045-867db4519370 req-a2f61ca0-d13d-479f-939c-b9ada9c91a99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036916 Jan 19 16:50:00.189380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1366/2059] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:50:00.370803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:00.371600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:00.378870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:00.379312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:00.380133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:00.380565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:00.526008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:00.533655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4dc12efd-d040-4308-a55d-1cb170a24067 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.166883 Jan 19 16:50:00.534228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1367/2060] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:00 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:00.818224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:00.818843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:00.824683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:00.825134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:00.825907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:00.826344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:00.884535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:00.893274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fff4eece-87f7-4870-a806-145261da296a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079098 Jan 19 16:50:00.894061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1368/2061] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:01.550669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:01.551308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:01.557522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:01.557977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:01.558756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:01.559196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:01.685851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:01.694057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f0699beb-7721-401f-8f32-69250b670bcb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147131 Jan 19 16:50:01.694631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1369/2062] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:01 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:01.909946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:01.910480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:01.916583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:01.917038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:01.917815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:01.918257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:01.978413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:01.986553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0da717d2-f1a7-4d95-b080-e1fae45bbbf5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.080246 Jan 19 16:50:01.987128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1370/2063] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:01 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:02.711358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:02.711997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:02.718254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:02.718706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:02.719465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:02.719928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:02.844817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:02.852690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ab348172-5b2c-40a4-9771-ae96f19e294a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144907 Jan 19 16:50:02.853254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1371/2064] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:02 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:03.003086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:03.003711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:03.009518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:03.009958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:03.010720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:03.011150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:03.068251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:03.075851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c1276c65-39ba-42d8-a7d1-ae1fc0b65cec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076307 Jan 19 16:50:03.076407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1372/2065] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:03.869875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:03.870515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:03.876762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:03.877215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:03.877977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:03.878405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:04.010578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:04.019051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-118ce975-06f6-420d-92c7-bd2721fea806 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.152757 Jan 19 16:50:04.019619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1373/2066] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:03 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:04.091101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:04.091753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:04.097418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:04.097872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:04.098654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:04.099095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:04.156786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:04.164375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c5a0acd1-494c-4c8f-8032-c95f376d61fb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076653 Jan 19 16:50:04.164946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1374/2067] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:05.035895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:05.036501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:05.042975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:05.043420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:05.044215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:05.044647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:05.172578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:05.180269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2d8a153a-5f0b-40e8-acf6-a17f2d4b113a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147964 Jan 19 16:50:05.180835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1375/2068] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:05 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:05.185236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:05.185832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:05.191923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:05.192400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:05.193291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:05.193728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:05.251773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:05.259460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-15b9f547-a439-403b-917b-92f2a1086add tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077702 Jan 19 16:50:05.260061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1376/2069] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:06.196769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:06.197494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:06.204583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:06.205033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:06.205807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:06.206246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:06.335272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:06.343203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-75c3bd6e-0328-4a63-8e50-5331d26aee05 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150054 Jan 19 16:50:06.343797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1377/2070] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:06 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:06.347887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:06.348485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:06.353754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:06.354207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:06.354974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:06.355412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:06.412231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:06.420057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b251b0c1-d71c-4af3-a016-cdef0654d7db tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075307 Jan 19 16:50:06.420622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1378/2071] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:07.359405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:07.360104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:07.366205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:07.366660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:07.367437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:07.367973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:07.494465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:07.502735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ce85fba-da3e-4da4-8b65-4a2170938f35 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147008 Jan 19 16:50:07.503313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1379/2072] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:07 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:07.507467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:07.508304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:07.514304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:07.515316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:07.516125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:07.516568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:07.576924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:07.585341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-079874de-80ef-43b8-abfc-8def08f6e973 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081062 Jan 19 16:50:07.585907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1380/2073] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:08.519617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:08.520317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:08.526463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:08.526907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:08.527669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:08.528129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:08.656785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:08.664343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-27513090-0069-47f2-ada8-b303fd5e33a8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148399 Jan 19 16:50:08.664907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1381/2074] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:08 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:08.669218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:08.669835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:08.675057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:08.675499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:08.676299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:08.676735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:08.737653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:08.745377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-61db0736-73a6-4746-b0d6-145f7b8b5200 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079547 Jan 19 16:50:08.745949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1382/2075] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:09.681225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:09.681885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:09.688168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:09.688620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:09.689392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:09.689828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:09.819979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:09.827611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2f5dcdb3-c0a7-4d90-b658-e796c643ac11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150052 Jan 19 16:50:09.828204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1383/2076] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:09 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:09.832342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:09.832945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:09.838458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:09.838917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:09.839758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:09.840573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:09.897969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:09.906192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-39edf695-9fab-456d-b064-eb09f10a7ce2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076517 Jan 19 16:50:09.906757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1384/2077] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:10.845066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:10.845729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:10.852214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:10.852671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:10.853465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:10.853926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:10.979798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:10.987355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4a8f3ccb-9f67-4f62-9882-5ed1b11ef8c3 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146595 Jan 19 16:50:10.987950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1385/2078] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:10 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:10.992068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:10.992777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:10.998138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:10.998591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:10.999422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:10.999890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:11.057235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:11.064913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-db573586-d462-4136-8162-e6e058000633 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076036 Jan 19 16:50:11.065481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1386/2079] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:12.003904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:12.004543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:12.010882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:12.011336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:12.012141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:12.012583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:12.142201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:12.149909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-04b4d1c0-cc9e-4f67-a45e-d845c89c5dbd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149626 Jan 19 16:50:12.150483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1387/2080] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:11 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:12.154778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:12.155920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:12.161369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:12.161825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:12.162603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:12.163045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:12.220853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:12.228470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-af7cc2c7-f180-470c-bfc7-31f25090fc56 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076991 Jan 19 16:50:12.229042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1388/2081] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:13.166543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:13.167183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:13.174266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:13.174727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:13.175516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:13.176023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:13.309343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:13.317659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b76620af-d4a5-4df1-b36e-fe6d8429d1b0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.155024 Jan 19 16:50:13.318228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1389/2082] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:13 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:13.322543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:13.323147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:13.328767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:13.329222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:13.329996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:13.330439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:13.388683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:13.396383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-131af904-b299-4d61-9461-3309caeefc37 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077223 Jan 19 16:50:13.396948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1390/2083] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:14.337264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:14.337951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:14.344312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:14.344763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:14.345536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:14.345970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:14.474640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:14.482278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-64118a4e-ee1c-4fce-8aec-b8b05e61f878 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148830 Jan 19 16:50:14.482844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1391/2084] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:14 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:14.487644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:14.488262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:14.493734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:14.494186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:14.494952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:14.495388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:14.558083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:14.565807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7198fd32-9e84-4dfb-9227-348786c0aef5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081397 Jan 19 16:50:14.566364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1392/2085] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:15.499607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:15.500263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:15.506493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:15.506945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:15.507730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:15.508168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:15.634448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:15.642147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-eb834f76-0754-4da3-aed5-db8764fe0cf5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146730 Jan 19 16:50:15.642714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1393/2086] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:15 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:15.646858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:15.647456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:15.653296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:15.653756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:15.654539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:15.654985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:15.717392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:15.725496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8fa8be64-697c-42d1-8f0e-3df2962f7808 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081846 Jan 19 16:50:15.726062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1394/2087] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:16.658080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:16.658754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:16.665037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:16.665746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:16.666516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:16.666988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:16.797064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:16.804755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2de5bbb0-7bf3-4206-bffc-b0884eae6038 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150362 Jan 19 16:50:16.805323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1395/2088] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:16 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:16.809414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:16.810013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:16.815978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:16.816428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:16.817202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:16.817636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:16.874848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:16.882483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-74a03220-67ec-4440-91b0-27362be3b911 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076236 Jan 19 16:50:16.883051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1396/2089] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:17.821712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:17.822331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:17.829209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:17.829665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:17.830473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:17.830914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:17.960654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:17.968472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8161c8a4-770c-4953-9e47-f9a1c1214146 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150394 Jan 19 16:50:17.969036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1397/2090] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:17 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:17.973296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:17.973896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:17.979230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:17.979700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:17.980491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:17.980935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:18.039298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:18.047146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5a71e450-1c9c-422c-b50c-d64c382dc68d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077181 Jan 19 16:50:18.047739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1398/2091] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:18.984459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:18.985082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:18.991322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:18.991812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:18.992587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:18.993030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:19.118881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:19.127055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4e1197b4-e462-43af-9549-e0ec64c9da50 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146303 Jan 19 16:50:19.127620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1399/2092] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:18 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:19.131940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:19.132541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:19.138407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:19.138860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:19.139701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:19.140151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:19.201000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:19.208618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-56a31615-da48-4f68-8526-3da73014a9e3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.080055 Jan 19 16:50:19.209178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1400/2093] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:20.144372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:20.145027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:20.151248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:20.151723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:20.152500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:20.152935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:20.281741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:20.289422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ffcedc76-d5ff-4ec9-8f2c-525d63fb7610 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148683 Jan 19 16:50:20.289986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1401/2094] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:20 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:20.294476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:20.295077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:20.300558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:20.301010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:20.301778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:20.302214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:20.359335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:20.366830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b2f06007-65ed-4376-83c9-cbe678829cc8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075668 Jan 19 16:50:20.367382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1402/2095] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:21.306509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:21.307154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:21.313554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:21.313999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:21.314762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:21.315189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:21.441515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:21.449169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-59db7ad1-560b-434c-a928-e78d10834ae8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146343 Jan 19 16:50:21.449737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1403/2096] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:21 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:21.454346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:21.455004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:21.460827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:21.461270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:21.462039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:21.462466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:21.525573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:21.534062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-19917915-cab3-4407-aec1-d810f2481e4d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.083400 Jan 19 16:50:21.534639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1404/2097] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:22.468298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:22.468981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:22.475065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:22.475509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:22.476310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:22.476744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:22.602941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:22.611225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1f7cddb2-de7b-45b0-b572-ab9d7d54e453 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147032 Jan 19 16:50:22.611828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1405/2098] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:22 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:22.615892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:22.616493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:22.621802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:22.622254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:22.623020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:22.623455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:22.682453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:22.690106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ce9e13b7-86db-4703-8ef6-ff71187d6437 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077367 Jan 19 16:50:22.690671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1406/2099] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:23.628389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:23.629071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:23.635184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:23.635631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:23.636417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:23.636848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:23.767876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:23.775571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ef33e894-05bf-4556-b20b-6fad32ecda11 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150755 Jan 19 16:50:23.776163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1407/2100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:23 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:23.780221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:23.780823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:23.786114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:23.786557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:23.787328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:23.787794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:23.845106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:23.852635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6cb2ed48-1a2c-4c4d-a8b7-3d3175dfd22a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075563 Jan 19 16:50:23.853194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1408/2101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:24.792938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:24.793595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:24.799938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:24.800395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:24.801176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:24.801618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:24.929537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:24.937727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc11d1f7-f3ab-40f8-ad8d-b29863df3a89 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148927 Jan 19 16:50:24.938291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1409/2102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:24 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:24.942410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:24.943011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:24.948405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:24.948853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:24.949618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:24.950053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:25.007652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:25.015935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a1296625-73ba-469d-99fa-26c9923b2ad5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076692 Jan 19 16:50:25.016499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1410/2103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:25.954424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:25.955039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:25.961349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:25.961802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:25.962568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:25.963006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:26.092243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:26.100521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e1fbe80c-223a-466a-9281-ab802da02c02 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150213 Jan 19 16:50:26.101086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1411/2104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:25 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:26.105170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:26.105771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:26.111116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:26.111568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:26.112370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:26.112809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:26.170396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:26.177912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-10d481f5-99cd-4cce-8839-d25e93b50eec tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075910 Jan 19 16:50:26.178478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1412/2105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:27.117265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:27.117877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:27.124191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:27.124640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:27.125404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:27.125836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:27.251894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:27.259430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8190ee2e-5da6-4595-802b-3b8b8b934cc2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145775 Jan 19 16:50:27.260021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1413/2106] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:27 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:27.264573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:27.265166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:27.270487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:27.270939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:27.271721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:27.272154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:27.331748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:27.340179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a5907af8-163d-46cd-bb40-3bf4379800d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079206 Jan 19 16:50:27.340751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1414/2107] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:28.276161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:28.276823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:28.283025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:28.283473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:28.284274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:28.284710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:28.414978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:28.423549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-761afaae-3927-4f8e-989f-4958deed0846 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151021 Jan 19 16:50:28.424145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1415/2108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:28 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:28.428353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:28.428957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:28.434526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:28.434987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:28.435813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:28.436321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:28.494384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:28.502127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3671a58-c228-45c0-9f7a-130d270a233a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077049 Jan 19 16:50:28.502695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1416/2109] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:28 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:29.440860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:29.441494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:29.447844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:29.448150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:29.448926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:29.449368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:29.576379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:29.584433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be9d2015-9181-47ff-88b2-8be023394da5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147228 Jan 19 16:50:29.585009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1417/2110] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:29 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:29.589153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:29.589757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:29.595307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:29.595801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:29.596587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:29.597061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:29.658473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:29.666543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8b72ef17-d5e3-4274-8ce5-d560bb5ab021 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.080609 Jan 19 16:50:29.667115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1418/2111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:30.601047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:30.601662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:30.608436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:30.608897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:30.609672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:30.610110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:30.736955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:30.744645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-762a3017-51b8-4170-a797-abce25ff7b54 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147314 Jan 19 16:50:30.745210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1419/2112] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:30 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:30.749374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:30.749972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:30.755329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:30.755818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:30.756597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:30.757043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:30.823921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:30.831588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b2ab9c9-83a8-43d5-aa07-1d63addabfbf tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.085443 Jan 19 16:50:30.832186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1420/2113] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:31.761388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:31.762006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:31.768963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:31.769417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:31.770194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:31.770637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:31.900319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:31.908632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8428b590-f646-41dc-b9fe-e4c2b3522368 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150914 Jan 19 16:50:31.909200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1421/2114] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:31 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:31.913330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:31.913931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:31.919519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:31.920008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:31.920806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:31.921245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:31.980004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:31.987628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3ffa0abf-f5ff-4eab-91f8-a0f1137e1716 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077504 Jan 19 16:50:31.988216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1422/2115] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:32.925556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:32.926231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:32.932408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:32.932798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:32.933556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:32.933987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:33.059309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:33.067478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e39bc2ba-b93d-4443-8541-5f4e33e8b492 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145577 Jan 19 16:50:33.068076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1423/2116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:32 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:33.072154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:33.072831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:33.078727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:33.079181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:33.079995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:33.080426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:33.136695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:33.144969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-80732877-e327-431c-886e-bccecf0d810a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075972 Jan 19 16:50:33.145536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1424/2117] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:34.085013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:34.085711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:34.091826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:34.092895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:34.093669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:34.094101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:34.227366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:34.235147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32e2fd39-f410-4bdf-84b8-74d98ab552a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153759 Jan 19 16:50:34.235729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1425/2118] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:34 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:34.239972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:34.240579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:34.246092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:34.246567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:34.247339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:34.247805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:34.304712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:34.312272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4a1c3e9-df0c-40fe-81f4-ce66d2342f8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075611 Jan 19 16:50:34.313670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1426/2119] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:35.251789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:35.252428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:35.258694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:35.259152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:35.259959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:35.260407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:35.386581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:35.394260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2726dce5-0fef-4090-9653-0fbc4711bbe5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146253 Jan 19 16:50:35.394855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1427/2120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:35 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:35.398945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:35.399544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:35.405490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:35.405998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:35.406791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:35.407231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:35.469945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:35.477753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-59c77f64-4161-42f2-bc91-ccac61a6b4d2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081965 Jan 19 16:50:35.478324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1428/2121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:35 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:36.410777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:36.411474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:36.417962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:36.418410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:36.419179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:36.419612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:36.547836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:36.555521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-54ac9131-0eec-4286-9faf-6c809c0aea26 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148372 Jan 19 16:50:36.556121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1429/2122] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:36 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:36.560210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:36.561380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:36.566670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:36.567126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:36.567944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:36.568386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:36.628678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:36.636326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e6cc0823-ef5d-4102-91ec-dd94e5d7c45b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079284 Jan 19 16:50:36.636887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1430/2123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:37.573014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:37.573675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:37.580927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:37.581370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:37.582135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:37.582568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:37.715244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:37.723048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-65230e34-a1e1-44cc-8f87-b820f5796b2a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153796 Jan 19 16:50:37.723602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1431/2124] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:37 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:37.727812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:37.728403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:37.733619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:37.734068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:37.734826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:37.735257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:37.792063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:37.799995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a7fff22-3fb7-47d1-a408-9311e105e6a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075426 Jan 19 16:50:37.800555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1432/2125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:38.740121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:38.740760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:38.747004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:38.747455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:38.748247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:38.748687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:38.878636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:38.886305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d047d888-4ec4-4975-85f6-eecc1b8ed112 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149785 Jan 19 16:50:38.886871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1433/2126] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:38 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:38.891528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:38.892163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:38.897534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:38.898007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:38.898759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:38.899195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:38.956428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:38.964021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b62e8c98-fd96-4a0b-aa12-23ac600e8c10 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076194 Jan 19 16:50:38.964595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1434/2127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:39.903645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:39.904270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:39.910476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:39.910922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:39.911781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:39.912167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:40.041662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:40.049846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e22d40ea-c372-4122-89b7-b79143bd167c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149873 Jan 19 16:50:40.050404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1435/2128] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:39 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:40.054455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:40.055048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:40.060344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:40.061436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:40.062197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:40.062863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:40.119369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:40.127567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-de49daf5-db10-4d33-b09a-dd206c750e4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076248 Jan 19 16:50:40.128169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1436/2129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:41.067124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:41.067802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:41.074264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:41.074722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:41.075495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:41.075969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:41.202605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:41.210329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5621404e-5f22-445b-9100-624e024d19ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146834 Jan 19 16:50:41.210893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1437/2130] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:41 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:41.214994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:41.215599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:41.221519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:41.221973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:41.222752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:41.223195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:41.281539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:41.289077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8025d6ac-1711-4781-9e2c-764e0905e42d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077260 Jan 19 16:50:41.289676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1438/2131] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:42.227420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:42.228112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:42.234870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:42.235319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:42.236117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:42.236557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:42.365873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:42.373605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ab48fc9-7708-490f-b20b-7a17dccc036f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149843 Jan 19 16:50:42.374171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1439/2132] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:42 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:42.378271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:42.378871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:42.384238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:42.384695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:42.385474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:42.385913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:42.443196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:42.450811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c28c5685-8021-42a1-8b0d-0e670a3cedfd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075711 Jan 19 16:50:42.451953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1440/2133] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:42 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:43.390910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:43.391508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:43.397472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:43.397928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:43.398698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:43.399135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:43.526863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:43.535799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-badff2c3-5299-4789-b9c9-a3bdd5f1576c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149227 Jan 19 16:50:43.536370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1441/2134] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:43 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:43.540777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:43.541385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:43.547437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:43.547917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:43.548686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:43.549123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:43.610199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:43.617900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bf1cb508-52c2-47fc-ba7f-deb68bc624b1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.080604 Jan 19 16:50:43.618464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1442/2135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:44.553301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:44.553987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:44.559963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:44.560422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:44.561200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:44.561640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:44.687774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:44.695574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d7459cc6-229e-4b53-a104-435d9a4ec82e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146001 Jan 19 16:50:44.696187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1443/2136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:44 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:44.700276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:44.700879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:44.706718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:44.707174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:44.707987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:44.708430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:44.765656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:44.773212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0f927f7f-0744-4215-9ac7-02643f0f146d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076096 Jan 19 16:50:44.773780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1444/2137] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:45.712990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:45.713643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:45.720468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:45.720920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:45.721691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:45.722131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:45.851004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:45.859384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1352a143-bcc0-4959-b4ca-cc832dbc3e7e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150078 Jan 19 16:50:45.860159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1445/2138] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:45 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:45.864370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:45.864970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:45.870369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:45.870826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:45.871598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:45.872068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:45.930840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:45.938643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76c11302-e73e-471b-9546-d72a51e3ae50 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077497 Jan 19 16:50:45.939152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1446/2139] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:46.876331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:46.877019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:46.883208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:46.884040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:46.884826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:46.885270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:47.012439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:47.020748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8920aca3-3687-4645-a3d9-eb6e00429181 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148147 Jan 19 16:50:47.021317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1447/2140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:46 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:47.025448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:47.026055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:47.032082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:47.032570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:47.033353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:47.033797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:47.090616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:47.098747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-19244892-9e5b-464c-9ea8-1a435b380ef3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076502 Jan 19 16:50:47.099323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1448/2141] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:48.038071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:48.038705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:48.045809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:48.046263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:48.047057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:48.047482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:48.177711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:48.185365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-83dbc46c-534d-412c-8c12-b94e169eb220 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150914 Jan 19 16:50:48.185935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1449/2142] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:48 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:48.190044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:48.190647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:48.195999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:48.196457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:48.197237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:48.197686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:48.254099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:48.261660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-330b8694-7296-4e48-8270-9ee5858c53d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.074795 Jan 19 16:50:48.262228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1450/2143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:48 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:49.201944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:49.202689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:49.208941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:49.209389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:49.210158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:49.210593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:49.336165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:49.343834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6c93e952-6425-44d0-acc8-fabc0c1feec0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145501 Jan 19 16:50:49.344408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1451/2144] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:49 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:49.348504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:49.349100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:49.354529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:49.354982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:49.355790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:49.356235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:49.414843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:49.423691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-98401a2a-271c-4fd1-9934-22a3a475461f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078294 Jan 19 16:50:49.424273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1452/2145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:50.359448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:50.360145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:50.366393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:50.366845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:50.367619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:50.368086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:50.502562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:50.510221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6102192b-aa96-4704-bf9a-8b9f5b87a90f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.154403 Jan 19 16:50:50.510782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1453/2146] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:50 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:50.515380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:50.516007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:50.521307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:50.521753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:50.522516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:50.522947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:50.581951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:50.589491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7374c0ce-c853-4b62-ab0b-0c03f558f6a8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077787 Jan 19 16:50:50.590068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1454/2147] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:51.527634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:51.528350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:51.534498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:51.534938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:51.535744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:51.536184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:51.660878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:51.668917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7376a540-fa13-4be9-961d-01c4adebfcdb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144947 Jan 19 16:50:51.669480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1455/2148] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:51 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:51.674126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:51.674728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:51.680224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:51.680683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:51.681468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:51.681911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:51.742410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:51.750015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8fe200dd-27f9-405f-9954-494c3ec56919 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079064 Jan 19 16:50:51.750584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1456/2149] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:52.686619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:52.687233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:52.693528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:52.694110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:52.694891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:52.695363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:52.820771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:52.828431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-019e11b0-20b3-4469-9141-c4d9c969cd68 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145986 Jan 19 16:50:52.828998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1457/2150] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:52 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:52.833147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:52.833750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:52.839065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:52.839520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:52.840339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:52.840782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:52.899633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:52.907389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-73ade8af-32e5-4bd1-b9ec-52ac64b8f8bc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077465 Jan 19 16:50:52.907996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1458/2151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:53.845560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:53.846211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:53.852685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:53.853250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:53.854039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:53.854480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:53.985045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:53.994105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9c1a3025-ee10-431b-adca-54edee42157a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151637 Jan 19 16:50:53.994670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1459/2152] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:53 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:53.998815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:53.999410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:54.004747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:54.005194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:54.005956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:54.006388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:54.068990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:54.076705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-363ba5b9-a3e4-40c8-9164-59b99c25b188 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081102 Jan 19 16:50:54.077254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1460/2153] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:55.010135 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:55.010748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:55.017559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:55.018016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:55.018793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:55.019239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:55.146148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:55.153865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-937d769c-4430-4325-9080-9538c29fd2bb tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147409 Jan 19 16:50:55.155037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1461/2154] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:55 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:55.159138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:55.159768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:55.165132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:55.165854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:55.166626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:55.167067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:55.223861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:55.231421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1d5eace4-d046-431e-9ead-219506fcaa4e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075454 Jan 19 16:50:55.232079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1462/2155] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:56.172055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:56.172728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:56.179081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:56.179535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:56.180333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:56.180769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:56.309194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:56.317488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2424277a-0abf-4f3d-8f77-4e47406b63f6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149099 Jan 19 16:50:56.318062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1463/2156] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:56 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:56.322151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:56.322753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:56.328836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:56.329288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:56.330067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:56.330531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:56.387006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:56.395397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d640b990-c3d7-4b32-b166-ef22ea22a70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076408 Jan 19 16:50:56.396003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1464/2157] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:56 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:57.334628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:57.335352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:57.342364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:57.342814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:57.343592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:57.344061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:57.471545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:57.479709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-63009f58-4eb7-4784-9e3e-a962d2d35afe tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149170 Jan 19 16:50:57.480325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1465/2158] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:57 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:57.484399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:57.484990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:57.490281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:57.490723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:57.491474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:57.491927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:57.552652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:57.561394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a2a5fdb5-cec7-4af4-a7a7-f0daf25d15f6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.080128 Jan 19 16:50:57.561964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1466/2159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:58.496410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:58.497056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:58.503293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:58.503808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:58.504587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:58.505027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:58.631601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:58.639276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-301f3439-9672-446b-92ee-f871dc094f23 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146490 Jan 19 16:50:58.639873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1467/2160] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:58 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:58.643985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:58.644595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:58.650246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:58.650692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:58.651464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:58.651928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:58.709745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:58.717843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-402c6f53-8bd3-4cc3-91d7-87c00272b83a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077043 Jan 19 16:50:58.718403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1468/2161] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:50:59.656836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:59.657500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:59.663421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:59.663904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:59.664681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:59.665122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:59.794155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:59.801738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f2287d0e-0ff4-4ead-8749-294123d3a2f1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149215 Jan 19 16:50:59.802296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1469/2162] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:59 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:50:59.806359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:50:59.806952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:50:59.812165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:59.812609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:59.813365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:50:59.813795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:50:59.869649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:50:59.877631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3196575b-756f-462e-a290-8326c141b6e1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.074425 Jan 19 16:50:59.878192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1470/2163] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:50:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:00.818201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:00.818821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:00.825076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:00.825528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:00.826934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:00.827372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:00.954406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:00.962050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9a8ca78e-04d6-4c9b-ac58-49ea3ee6f91e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147614 Jan 19 16:51:00.962613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1471/2164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:00 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:00.967271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:00.967899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:00.973261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:00.973712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:00.974486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:00.974919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:01.032158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:01.039644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4fc9d77-03f4-45df-95e0-ff1263fc642e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076109 Jan 19 16:51:01.040234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1472/2165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:01.979249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:01.979949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:01.986189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:01.986641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:01.987409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:01.987883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:02.123100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:02.130717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e8e585c6-565b-49fc-9938-1988ecf3718e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.155085 Jan 19 16:51:02.131284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1473/2166] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:01 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:02.135478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:02.136102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:02.142056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:02.142507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:02.143273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:02.143735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:02.200144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:02.208286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a6c091f6-8ae7-4fcb-855d-e9fe36d82dff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076044 Jan 19 16:51:02.208846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1474/2167] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:02 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:03.147905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:03.148514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:03.155213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:03.155663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:03.156446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:03.156875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:03.282881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:03.290829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5e051202-8b18-4322-acb7-920f2142824a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146279 Jan 19 16:51:03.291402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1475/2168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:03 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:03.296030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:03.296743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:03.302286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:03.302745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:03.303525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:03.304023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:03.364162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:03.371943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40b240c5-b123-42f5-9953-94d457a1f2d1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079549 Jan 19 16:51:03.373148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1476/2169] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:04.307969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:04.308632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:04.315521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:04.316010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:04.316787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:04.317229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:04.446194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:04.455452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7f89a59d-43bc-49a8-abbf-98639eb97f1d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151090 Jan 19 16:51:04.456050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1477/2170] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:04 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:04.460297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:04.460904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:04.466911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:04.467365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:04.468170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:04.468612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:04.525894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:04.533993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c1d1a74d-ca29-4250-bb99-8b2579678e36 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077011 Jan 19 16:51:04.534559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1478/2171] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:05.472389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:05.473118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:05.479375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:05.479882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:05.480669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:05.481107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:05.610028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:05.617665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b9e94ab4-197a-47ca-a415-73cf027de7fc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148970 Jan 19 16:51:05.618234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1479/2172] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:05 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:05.623082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:05.623649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:05.629325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:05.629803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:05.630569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:05.631023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:05.689462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:05.697161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b9174fe8-8ae1-4706-bf70-64ec3b645b29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078004 Jan 19 16:51:05.697729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1480/2173] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:06.635034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:06.635731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:06.642545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:06.643013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:06.643823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:06.644269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:06.769959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:06.777590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fa513815-a605-48ce-ad97-ddd8a79517c5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146366 Jan 19 16:51:06.778159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1481/2174] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:06 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:06.782218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:06.782820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:06.788406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:06.788866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:06.789650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:06.790089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:06.846990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:06.854614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8d613746-ab9d-440b-a6fa-0834bba1cb6a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075535 Jan 19 16:51:06.855184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1482/2175] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:07.795011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:07.795612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:07.806773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:07.807230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:07.808063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:07.808505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:07.937553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:07.945249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a836046e-89f7-489c-9ea0-596518c6c84e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153898 Jan 19 16:51:07.945819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1483/2176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:07 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:07.949906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:07.951007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:07.956401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:07.956851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:07.957619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:07.958055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:08.014713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:08.022313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-04e963a5-9daa-4e77-92e1-97289a927d6f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075571 Jan 19 16:51:08.022875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1484/2177] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:08.962404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:08.963093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:08.969431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:08.969882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:08.970657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:08.971097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:09.097329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:09.105222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3563f763-0f2f-4c01-b0d4-6edb3c6451c9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146428 Jan 19 16:51:09.105797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1485/2178] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:08 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:09.109906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:09.110507 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:09.115814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:09.116269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:09.117044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:09.117487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:09.177893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:09.186293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-199e6ac8-430e-41a8-9946-fc1f22daf196 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079551 Jan 19 16:51:09.186864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1486/2179] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:09 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:10.121907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:10.122602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:10.128786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:10.129239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:10.130010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:10.130456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:10.484970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:10.492612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f4b438d6-5670-4e7b-9ad2-dc7a244ca049 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.374377 Jan 19 16:51:10.493181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1487/2180] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:10 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:10.644156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:10.644774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:10.650553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:10.651005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:10.651812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:10.652251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:10.710421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:10.718088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e198b270-d846-4a21-860c-1ce45e01e7fe tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.223992 Jan 19 16:51:10.718649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1488/2181] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:11.509845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:11.510621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:11.517334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:11.517791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:11.518578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:11.519021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:11.648052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:11.656366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a022e989-06a1-4e9b-9cca-fe784528b7ce tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150226 Jan 19 16:51:11.656942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1489/2182] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:11 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:11.734146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:11.734762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:11.740571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:11.741027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:11.741802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:11.742242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:11.802480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:11.810110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d9fe94ab-0574-45e9-9ccb-2dcef2caff84 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079451 Jan 19 16:51:11.810715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1490/2183] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:12.674110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:12.674778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:12.681081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:12.681539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:12.682318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:12.682761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:12.808760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:12.817152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dc6c7072-1564-46a0-9c52-d4f4fba9dac5 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146727 Jan 19 16:51:12.817732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1491/2184] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:12 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:12.827189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:12.827824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:12.833324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:12.833777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:12.834585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:12.835023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:12.891534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:12.899082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e37c77a4-a363-4efe-925d-baebcf4e7a85 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075727 Jan 19 16:51:12.899729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1492/2185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:13.834132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:13.834760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:13.840996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:13.841963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:13.842720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:13.843152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:14.055434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:14.062988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2128b3ae-7eb8-4efd-b46f-c1e04592971e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.232543 Jan 19 16:51:14.063544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1493/2186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:13 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:14.067569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:14.068191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:14.073417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:14.073865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:14.074638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:14.075069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:14.133598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:14.141844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-860eb227-e1aa-4fbe-b676-9b1e1cbb5bc4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077365 Jan 19 16:51:14.142400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1494/2187] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:14 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:15.080592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:15.081200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:15.087180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:15.087625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:15.088413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:15.088846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:15.214434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:15.222143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-05baa760-0030-4253-8b24-ba31a16856bf tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145225 Jan 19 16:51:15.222703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1495/2188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:15 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:15.226768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:15.227362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:15.232706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:15.233157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:15.233922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:15.234356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:15.295155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:15.302744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dd657522-b5e0-4bf6-a64d-fd684c6f72bd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079121 Jan 19 16:51:15.303333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1496/2189] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:16.238643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:16.239348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:16.245534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:16.245991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:16.246767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:16.247864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:16.372861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:16.380525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3cd34255-cd82-45e8-b300-fc61b62eece8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145530 Jan 19 16:51:16.381096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1497/2190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:16 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:16.385202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:16.385806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:16.391172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:16.391626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:16.392439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:16.392888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:16.449732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:16.457381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-351bfc18-3eaa-41e5-9d86-db5d81a6c2ba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075353 Jan 19 16:51:16.458072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1498/2191] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:17.396718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:17.397371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:17.403512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:17.404035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:17.404813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:17.405257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:17.535603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:17.543611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ca07ff38-eaff-4a06-9def-97cdd833597f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150615 Jan 19 16:51:17.544791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1499/2192] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:17 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:17.548944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:17.549581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:17.554980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:17.555438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:17.556247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:17.556685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:17.613987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:17.621547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c009a576-e773-4eb9-add9-6a810228855f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075833 Jan 19 16:51:17.622830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1500/2193] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:18.560984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:18.561676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:18.567973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:18.568430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:18.569203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:18.569640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:18.697550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:18.705856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-350a72e6-31dd-4510-a1e5-372191c9ff29 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148509 Jan 19 16:51:18.706436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1501/2194] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:18 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:18.710655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:18.711262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:18.716623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:18.717072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:18.717837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:18.718274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:18.775008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:18.782561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b052bf73-6137-4843-853d-a129ceb08d17 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075132 Jan 19 16:51:18.783129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1502/2195] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:19.722421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:19.723069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:19.729309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:19.729757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:19.730528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:19.730962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:19.863062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:19.872869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1f135de1-94e6-42c7-a349-b05c1650461d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.154015 Jan 19 16:51:19.873448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1503/2196] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:19 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:19.877702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:19.878313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:19.883920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:19.884377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:19.885150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:19.885586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:20.097434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:20.105172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-77ff3211-095b-4a7e-aaea-1bdf664b4580 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.230794 Jan 19 16:51:20.105731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1504/2197] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:20.889635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:20.890289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:20.896533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:20.897017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:20.897800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:20.898239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:21.024939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:21.033218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-15f60816-afe0-4ce7-915b-e19120776740 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147306 Jan 19 16:51:21.033767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1505/2198] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:20 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:21.121368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:21.121964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:21.127654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:21.128126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:21.128888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:21.129322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:21.193701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:21.201369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f42c600d-1a8b-4f1f-a023-df1e8ac9bea8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.083504 Jan 19 16:51:21.201913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1506/2199] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:21 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:22.050087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:22.050757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:22.057068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:22.057523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:22.058303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:22.058746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:22.184180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:22.191787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b3fa393e-f4a1-4dd0-af50-7f79f333b1ba tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145346 Jan 19 16:51:22.192351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1507/2200] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:22 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:22.216800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:22.217404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:22.223228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:22.223697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:22.224490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:22.224934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:22.282162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:22.289647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-57d6f0b7-91c2-49f6-8a43-737d2e08ad18 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076644 Jan 19 16:51:22.290200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1508/2201] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:22 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:23.208442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:23.209102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:23.215373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:23.216345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:23.217116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:23.217542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:23.345760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:23.353384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-31697813-e3c2-44d8-a283-6e4006aa6935 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148586 Jan 19 16:51:23.353932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1509/2202] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:23 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:23.358517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:23.359107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:23.364355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:23.364799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:23.365556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:23.365991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:23.424186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:23.431856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-65e8ceeb-ed20-4998-ae7a-06b07dd2c70e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076971 Jan 19 16:51:23.432405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1510/2203] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:23 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:24.369975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:24.370640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:24.376890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:24.377346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:24.378115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:24.378555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:24.506088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:24.513858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7964a1e8-4900-4403-a611-5a94532f7dac tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147507 Jan 19 16:51:24.514407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1511/2204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:24 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:24.518477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:24.519069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:24.524398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:24.524844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:24.525600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:24.526030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:24.582921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:24.590612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-71aab9f9-0d00-4183-8407-14100d87d36c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075287 Jan 19 16:51:24.591175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1512/2205] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:24 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:25.530346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:25.531009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:25.537438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:25.537894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:25.538672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:25.539120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:25.670122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:25.677732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a16d188-d02b-44c4-936f-e5dd582ae964 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151041 Jan 19 16:51:25.678293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1513/2206] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:25 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:25.682492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:25.683096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:25.689190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:25.689648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:25.690419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:25.690859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:25.748550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:25.756173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5d28bb6a-1e75-4e80-a312-565d3adaee77 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076956 Jan 19 16:51:25.756724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1514/2207] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:25 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:26.694319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:26.694957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:26.701677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:26.702146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:26.702906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:26.703339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:26.828937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:26.836693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-21c3fbff-a878-40dd-894e-d2d49a736678 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146279 Jan 19 16:51:26.837245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1515/2208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:26 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:26.842093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:26.842754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:26.848055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:26.848497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:26.849272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:26.849700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:26.910483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:26.918328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8d0ab716-5919-4dc1-971e-36e0175fec43 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.080166 Jan 19 16:51:26.919627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1516/2209] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:26 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:27.853143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:27.853759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:27.860670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:27.861126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:27.861901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:27.862341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:27.988067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:27.996053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-77c87e93-c78f-40d2-bfb6-50138c240bb6 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146369 Jan 19 16:51:27.996616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1517/2210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:27 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:28.000851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:28.001453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:28.006750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:28.007207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:28.008020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:28.008468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:28.066834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:28.074490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-23517b73-7d7b-4014-af1f-5c81ba140047 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076944 Jan 19 16:51:28.075580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1518/2211] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:27 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:29.012656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:29.013331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:29.019548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:29.020033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:29.020807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:29.021243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:29.150381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:29.158607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b2ec1688-2362-4a30-a7c8-8695436bbe4a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149595 Jan 19 16:51:29.159168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1519/2212] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:29 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:29.163418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:29.164053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:29.170329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:29.170779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:29.171555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:29.172022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:29.228697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:29.236929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32dad82a-352d-4555-bc53-6ff2236d4677 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076827 Jan 19 16:51:29.237484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1520/2213] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:29 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:30.175257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:30.175959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:30.182105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:30.182554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:30.183317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:30.183782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:30.310567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:30.318143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2dfc046d-3253-4dcf-a0f2-258a17176767 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146470 Jan 19 16:51:30.318696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1521/2214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:30 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:30.322743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:30.323331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:30.329119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:30.329565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:30.330327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:30.330757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:30.386637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:30.394661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c094b153-0365-4577-bce9-0ad19025608e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075044 Jan 19 16:51:30.395215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1522/2215] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:30 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:31.335488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:31.336155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:31.342980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:31.343437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:31.344242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:31.344683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:31.473703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:31.481304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-61835ac1-b0fb-472c-a997-b628d6905fd2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149594 Jan 19 16:51:31.481867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1523/2216] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:31 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:31.486002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:31.486595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:31.491832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:31.492283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:31.493046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:31.493478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:31.552532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:31.560820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-114cf22f-f37c-40a8-87e0-9bad4362ef29 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078037 Jan 19 16:51:31.561377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1524/2217] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:31 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:32.497923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:32.498693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:32.504749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:32.505200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:32.505967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:32.506401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:32.633150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:32.641338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3147d9c-35fc-4f65-9673-f592d900a7d9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147094 Jan 19 16:51:32.641897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1525/2218] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:32 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:32.646105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:32.646715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:32.652384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:32.653506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:32.654289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:32.654730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:32.716935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:32.724613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-02c0ef7d-c418-42e4-b905-bb5583847a2b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081777 Jan 19 16:51:32.725178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1526/2219] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:32 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:33.658289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:33.658963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:33.665189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:33.665890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:33.666658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:33.667093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:33.792909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:33.800735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c943e9ad-6e92-4fc9-8d19-d48c75a22c3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146027 Jan 19 16:51:33.801294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1527/2220] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:33 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:33.805451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:33.806044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:33.811996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:33.812441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:33.813198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:33.813630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:33.870022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:33.877957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aae18919-6620-4ce9-a267-84d05aaceef1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075748 Jan 19 16:51:33.878510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1528/2221] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:33 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:34.818019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:34.818615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:34.825431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:34.825884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:34.826663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:34.827102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:34.956012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:34.963860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ebffa16-66d1-4d35-9427-0f006bb3d0bd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149497 Jan 19 16:51:34.964447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1529/2222] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:34 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:34.969194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:34.969887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:34.975226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:34.975668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:34.976460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:34.976889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:35.034394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:35.042839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-556dbd11-357b-47a7-b867-3c5f06a933da tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077471 Jan 19 16:51:35.043421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1530/2223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:34 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:35.981980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:35.982680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:35.988802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:35.989250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:35.990012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:35.990441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:36.115797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:36.123339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1531e614-456d-4743-8242-be9226ffcd3a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145636 Jan 19 16:51:36.123926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1531/2224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:35 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:36.128133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:36.129194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:36.134558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:36.135000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:36.135860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:36.136297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:36.198784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:36.206323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-837fb675-d52b-46de-b71f-07d84184ccba tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081473 Jan 19 16:51:36.206890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1532/2225] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:36 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:37.140075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:37.140703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:37.146935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:37.147391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:37.148192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:37.148664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:37.277503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:37.285220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-22fe5540-236b-48c6-ba33-4091a57ed0af tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148810 Jan 19 16:51:37.285789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1533/2226] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:37 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:37.289917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:37.290785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:37.296625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:37.297117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:37.297892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:37.298339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:37.358364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:37.366197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-028cc1e9-7551-48c0-9e8d-511093822aa2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079479 Jan 19 16:51:37.366760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1534/2227] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:37 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:38.303044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:38.303756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:38.309941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:38.310399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:38.311171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:38.311609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:38.446514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:38.454613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-12d8671d-6d97-460d-bbca-23e0d6a07fc9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.155262 Jan 19 16:51:38.455183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1535/2228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:38 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:38.459465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:38.460098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:38.467429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:38.467923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:38.468709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:38.469153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:38.533009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:38.541283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-375c7cb5-b4b5-4073-b0b9-27a9f3131452 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.084946 Jan 19 16:51:38.542262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1536/2229] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:38 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:39.471024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:39.471714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:39.477941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:39.478399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:39.479171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:39.479611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:39.606364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:39.614040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a87baa40-0934-4330-b27a-4234acf8ac14 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146733 Jan 19 16:51:39.614599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1537/2230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:39 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:39.619008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:39.619599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:39.625562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:39.626119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:39.626884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:39.627314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:39.685040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:39.692724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a3e35449-9941-4d17-b63c-d5c23e56af02 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077200 Jan 19 16:51:39.693292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1538/2231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:39 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:40.631127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:40.631854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:40.637990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:40.638438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:40.639199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:40.639630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:40.769384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:40.777085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7f5da605-0d83-4d0c-ba21-b89a7516f505 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149597 Jan 19 16:51:40.777645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1539/2232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:40 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:40.782267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:40.782861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:40.788163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:40.788615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:40.789386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:40.789823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:40.846800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:40.854252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0e28a1d3-bfe5-44d8-aa7f-8660a1cae390 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075141 Jan 19 16:51:40.854806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1540/2233] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:40 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:41.794911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:41.795519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:41.801805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:41.802254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:41.803053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:41.803486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:41.928735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:41.936478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4c909eaa-82a4-491d-9248-f7b3a2460593 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145917 Jan 19 16:51:41.936975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1541/2234] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:41 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:41.941062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:41.941661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:41.947035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:41.947487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:41.948297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:41.948757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:42.007326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:42.014849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ac77c13b-7060-40b9-be68-e1ba6422a5dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076950 Jan 19 16:51:42.015515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1542/2235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:41 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:42.953569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:42.954214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:42.960586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:42.961037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:42.961802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:42.962245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:43.103958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:43.111755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f494edb0-5232-429e-af30-6a2eeeebfe72 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.162304 Jan 19 16:51:43.112268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1543/2236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:42 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:43.116383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:43.116996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:43.122379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:43.122887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:43.123662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:43.124127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:43.181495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:43.189127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d16a66cf-84f8-402d-9e6c-51e98ab83498 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075930 Jan 19 16:51:43.189685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1544/2237] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:43 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:44.128185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:44.129514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:44.135816 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:44.136269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:44.137676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:44.138114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:44.264673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:44.272534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8086f561-9d39-49f9-9728-056c401577c7 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147930 Jan 19 16:51:44.273103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1545/2238] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:44 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:44.277263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:44.277860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:44.283265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:44.283747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:44.284517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:44.284953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:44.345225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:44.352845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-36ad4394-c395-4133-ae3f-e05eb1477a11 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078771 Jan 19 16:51:44.353398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1546/2239] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:44 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:45.289303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:45.289940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:45.296946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:45.297396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:45.298171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:45.298612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:45.425018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:45.433406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-53558422-a0f9-4aed-be83-48d17e360487 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.147792 Jan 19 16:51:45.433967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1547/2240] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:45 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:45.438875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:45.439476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:45.444906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:45.445368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:45.446142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:45.446581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:45.504985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:45.512745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-33e74b09-ae50-47cd-b5b2-cdc1ce6193fc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077160 Jan 19 16:51:45.513304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1548/2241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:45 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:46.452841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:46.453561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:46.459837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:46.460294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:46.461071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:46.461510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:46.591234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:46.598944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d574e25b-76b1-4e20-8121-69f9ddb32ffa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.150358 Jan 19 16:51:46.599505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1549/2242] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:46 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:46.603582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:46.604209 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:46.609553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:46.609999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:46.610765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:46.611201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:46.670646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:46.678373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-01219d40-533e-46a2-ad33-da7c972448cc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077913 Jan 19 16:51:46.678941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1550/2243] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:46 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:47.614992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:47.615706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:47.621900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:47.622350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:47.623118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:47.623554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:47.752674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:47.760456 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c07cc403-e465-4d43-993f-8d9cedb3d4ee tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149184 Jan 19 16:51:47.761023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1551/2244] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:47 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:47.765626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:47.766219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:47.771527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:47.772016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:47.772787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:47.773227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:47.830149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:47.837717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8811e426-cff5-4dee-97a9-a04452b33d13 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075769 Jan 19 16:51:47.838277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1552/2245] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:47 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:48.777739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:48.778408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:48.784653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:48.785104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:48.785869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:48.786308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:49.015970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:49.023659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c7712470-ca81-4134-8f66-e1eb85ea9e6d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.249647 Jan 19 16:51:49.024264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1553/2246] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:48 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:49.028964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:49.029570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:49.035302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:49.035956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:49.036565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:49.037009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:49.099495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:49.107703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-58c5d688-7401-4d64-b59b-ff7fbb9575d9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.082442 Jan 19 16:51:49.108277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1554/2247] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:49 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:50.039942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:50.040847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:50.046973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:50.047417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:50.048213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:50.048647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:50.174390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:50.182015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-78790fd5-bf29-489e-9446-7d47f2f0539b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145697 Jan 19 16:51:50.182575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1555/2248] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:50 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:50.187150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:50.187773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:50.193126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:50.193572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:50.194328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:50.194762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:50.251009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:50.258455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79548219-94da-42d2-b6f0-2fdf473beae8 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.074972 Jan 19 16:51:50.259013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1556/2249] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:50 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:51.198946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:51.199610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:51.205755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:51.206199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:51.207056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:51.207491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:51.336569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:51.344728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f1ad6f3a-8b4b-4911-88d8-abe15c857d51 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149350 Jan 19 16:51:51.345288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1557/2250] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:51 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:51.349400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:51.349995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:51.355432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:51.355911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:51.356671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:51.357099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:51.417030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:51.425396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2a98d8e1-480e-4fc6-b2b0-ac89327c64f4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079162 Jan 19 16:51:51.425963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1558/2251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:51 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:52.362873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:52.363577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:52.369879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:52.370330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:52.371103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:52.372233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:52.500099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:52.507775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a31da77e-305a-4140-8e98-d4b324a54328 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148574 Jan 19 16:51:52.508339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1559/2252] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:52 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:52.512433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:52.513063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:52.518409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:52.518862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:52.519804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:52.520255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:52.580497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:52.588127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3bccae80-1ac9-4a03-9b30-6f0f768eb7c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078823 Jan 19 16:51:52.588695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1560/2253] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:52 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:53.524294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:53.524959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:53.531284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:53.531764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:53.532541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:53.532984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:53.658960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:53.666930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-989d3819-2cd9-4af2-8baa-a00b78c5db13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146281 Jan 19 16:51:53.667508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1561/2254] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:53 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:53.672145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:53.672748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:53.678124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:53.678579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:53.679364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:53.679841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:53.740568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:53.748751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc1ba837-9dcf-43a3-83b5-ce077ae615c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.080291 Jan 19 16:51:53.749349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1562/2255] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:54.684533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:54.685142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:54.691421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:54.691913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:54.692694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:54.693129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:54.823362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:54.831780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3045f826-e230-4a5e-9f40-e41576242c49 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.151380 Jan 19 16:51:54.832352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1563/2256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:54 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:54.836477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:54.837076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:54.842399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:54.842853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:54.843621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:54.844082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:54.901341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:54.909045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d319068c-b158-4dc1-ad45-bc5365d32914 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075771 Jan 19 16:51:54.909603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1564/2257] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:54 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:55.848659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:55.849322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:55.855452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:55.855941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:55.856711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:55.857150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:55.985320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:55.993010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-744fe754-d17d-41a4-b1b7-82e4892042c8 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148021 Jan 19 16:51:55.993569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1565/2258] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:55 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:55.997803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:55.998399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:56.003721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:56.004178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:56.004953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:56.005385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:56.063658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:56.071225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40570754-6a78-40b1-816e-e8cc59d48b9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076735 Jan 19 16:51:56.071803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1566/2259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:55 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:57.009719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:57.010391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:57.016701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:57.017157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:57.017933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:57.018375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:57.151691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:57.159340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d935dfad-f098-4320-87ca-9b41eaf784f9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153378 Jan 19 16:51:57.159925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1567/2260] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:57 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:57.164003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:57.164591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:57.170654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:57.171101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:57.171893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:57.172325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:57.228689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:57.236724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ea5e504-a025-4456-83bb-61afb3c6880e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075887 Jan 19 16:51:57.237275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1568/2261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:57 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:58.175888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:58.176498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:58.182705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:58.183154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:58.184454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:58.184893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:58.310304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:58.318148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5e45a7c2-2e93-4c10-afe8-b6ef44f4451d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145854 Jan 19 16:51:58.318707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1569/2262] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:58 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:58.322960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:58.323564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:58.329596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:58.330046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:58.330822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:58.331263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:58.391315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:58.399174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3b79d710-4b0f-4f70-ba64-3c40007623df tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079518 Jan 19 16:51:58.399770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1570/2263] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:58 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:59.335412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:59.336051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:59.343045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.343499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:59.344302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.344740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:59.472963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:59.480670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-39151dc4-076a-43c8-8470-55675957596a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148950 Jan 19 16:51:59.481239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1571/2264] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:59 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:51:59.485370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:59.485970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:59.491423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.491913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:59.492695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.493138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:59.552028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:51:59.560449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-af4f4335-729f-4cd6-b860-b7d7c1e61adc tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078258 Jan 19 16:51:59.561025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1572/2265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:59 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:51:59.800695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:59.801240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:59.807033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.807486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:59.808287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.809264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:59.833686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:51:59.908224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-57656cd3-9aef-4d96-90a2-b751ef547bd0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 204 len: 0 microversion: 2.1 time: 0.110909 Jan 19 16:51:59.908814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1573/2266] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:51:59 2022] DELETE /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:51:59.919731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:51:59.920446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:51:59.926329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.926774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:51:59.927537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:51:59.927995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:00.058459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:00.066366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c3f1150b-646f-44cb-b7f5-afc39d718d32 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1506 microversion: 2.1 time: 0.152720 Jan 19 16:52:00.066934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1574/2267] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:51:59 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:00.497033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:00.497579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:00.503562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:00.504247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:00.505225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:00.505826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:00.726091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:00.733811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f664c144-b0f9-4d53-a14e-fcbf635ba609 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.240768 Jan 19 16:52:00.734314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1575/2268] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:00 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:00.743564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:00.743564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:00.745164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:00.745610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:00.746403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:00.746807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:00.834754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:00.843094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-426b0770-8720-445d-8168-02baaa6692d5 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.107852 Jan 19 16:52:00.843651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1576/2269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:00 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:01.074103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-899a13f1-2793-4aaa-aef1-5813dc473079 req-333a74f0-d2d8-4a46-bcaa-110d0a5270d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d20a698-3a57-4315-999f-c09f58ed0a9a", "name": "network-vif-deleted", "tag": "4aa4e1b6-6c76-4244-8551-db8fd29f4a1e"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:01.076401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:52:01.076401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:52:01.084198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-899a13f1-2793-4aaa-aef1-5813dc473079 req-333a74f0-d2d8-4a46-bcaa-110d0a5270d6 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.084649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-899a13f1-2793-4aaa-aef1-5813dc473079 req-333a74f0-d2d8-4a46-bcaa-110d0a5270d6 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.096022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-899a13f1-2793-4aaa-aef1-5813dc473079 req-333a74f0-d2d8-4a46-bcaa-110d0a5270d6 service nova] Creating event network-vif-deleted:4aa4e1b6-6c76-4244-8551-db8fd29f4a1e for instance 4d20a698-3a57-4315-999f-c09f58ed0a9a on hv-cinder-78447 Jan 19 16:52:01.100583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-899a13f1-2793-4aaa-aef1-5813dc473079 req-333a74f0-d2d8-4a46-bcaa-110d0a5270d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089143 Jan 19 16:52:01.101176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1577/2270] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:52:01.105874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:01.106580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:01.112496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.112944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.113715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.114150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.148049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.148500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.148947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lazy-loading 'fault' on Instance uuid 4d20a698-3a57-4315-999f-c09f58ed0a9a {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:52:01.190330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:01.197519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3b58fd2-9a91-4444-91d0-d42b8eaeb449 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 200 len: 1311 microversion: 2.1 time: 0.095269 Jan 19 16:52:01.198100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1578/2271] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:01 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:01.751357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:01.752061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:01.758192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.758636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.759399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.759869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.888093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:01.895803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7aa7af45-1198-4fc8-bf69-2ad1f346272e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148023 Jan 19 16:52:01.896367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1579/2272] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:01 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:01.900603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:01.901236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:01.907070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.907527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.908339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:01.908790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:01.965993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:01.973638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-60f51b7a-36bf-437d-bd35-77fec2166b2d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076339 Jan 19 16:52:01.974193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1580/2273] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:01 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:02.214403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:02.215548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: 4d20a698-3a57-4315-999f-c09f58ed0a9a] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:02.221389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.221845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:02.222625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.223058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:02.235884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] HTTP exception thrown: Instance 4d20a698-3a57-4315-999f-c09f58ed0a9a could not be found. Jan 19 16:52:02.236468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Returning 404 to user: Instance 4d20a698-3a57-4315-999f-c09f58ed0a9a could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:52:02.237269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8c445101-a104-4ace-a05a-fdd89daff6c7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a" status: 404 len: 111 microversion: 2.1 time: 0.026428 Jan 19 16:52:02.237785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1581/2274] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:02 2022] GET /compute/v2.1/servers/4d20a698-3a57-4315-999f-c09f58ed0a9a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:52:02.244906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:02.245392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:02.250713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.251165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:02.251967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.252411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:02.278035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:52:02.350149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5dd2a593-e171-4cf7-a990-7df585f00996 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 204 len: 0 microversion: 2.1 time: 0.107850 Jan 19 16:52:02.353891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1582/2275] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:52:02 2022] DELETE /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:52:02.359048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:02.359773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:02.365382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.365837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:02.366610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.367052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:02.494759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:02.502915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3c294cb2-7a38-4ced-abed-a35c6b80b5b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1567 microversion: 2.1 time: 0.147859 Jan 19 16:52:02.503468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1583/2276] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:02.912798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:02.913436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:02.920570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.921018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:02.921792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:02.922234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:03.167185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:03.175373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9410a923-95de-4ccb-aa3d-a874bd1ad8d1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.266372 Jan 19 16:52:03.175973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1584/2277] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:02 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:03.180126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:03.180732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:03.186887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:03.187340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:03.188146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:03.188579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:03.252189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:03.259761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4a45501d-6cb3-434c-bd24-d77d924d4261 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.082831 Jan 19 16:52:03.260324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1585/2278] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:03 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:03.459553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-a3ba206f-efbc-4ec6-8fdc-a2a100cb190e req-137a7919-1d20-48a5-a885-ad9f6650af17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e119b741-b721-47fa-a03f-be8689acf2fd", "name": "network-vif-deleted", "tag": "c02d0a60-5805-45f1-8282-6b84dd2841e0"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:03.461606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:52:03.461606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:52:03.470653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-a3ba206f-efbc-4ec6-8fdc-a2a100cb190e req-137a7919-1d20-48a5-a885-ad9f6650af17 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:03.471180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-a3ba206f-efbc-4ec6-8fdc-a2a100cb190e req-137a7919-1d20-48a5-a885-ad9f6650af17 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:03.483150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-a3ba206f-efbc-4ec6-8fdc-a2a100cb190e req-137a7919-1d20-48a5-a885-ad9f6650af17 service nova] Creating event network-vif-deleted:c02d0a60-5805-45f1-8282-6b84dd2841e0 for instance e119b741-b721-47fa-a03f-be8689acf2fd on hv-cinder-78447 Jan 19 16:52:03.488171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-a3ba206f-efbc-4ec6-8fdc-a2a100cb190e req-137a7919-1d20-48a5-a885-ad9f6650af17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032203 Jan 19 16:52:03.488767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1586/2279] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:52:03.520378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:03.521081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:03.527982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:03.528465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:03.529234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:03.529671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:03.592799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:03.600488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bfdab07c-a416-4bfb-8316-3329d89a9573 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.084074 Jan 19 16:52:03.601044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1587/2280] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:04.191820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:04.192502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:04.198464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:04.198917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:04.200361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:04.200804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:04.325333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:04.333056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1f03ec1d-bba8-4077-b86e-ffc3c0c6d9ca tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.144782 Jan 19 16:52:04.333623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1588/2281] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:04 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:04.337763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:04.338362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:04.344079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:04.344534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:04.345316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:04.345758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:04.404996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:04.412638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9c57afa0-02e5-4a17-bb41-dc44665679c9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078089 Jan 19 16:52:04.413208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1589/2282] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:04 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:04.617385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:04.617994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:04.624537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:04.624994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:04.626118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:04.626567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:04.685383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:04.693080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a42d4c3a-7e15-4b9f-8614-95ede6fbc80d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079294 Jan 19 16:52:04.693633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1590/2283] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:05.349849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:05.350452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:05.357322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:05.357777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:05.358554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:05.358996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:05.487774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:05.495363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d1654560-e1e7-4da2-b148-af172dc1aef2 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.149229 Jan 19 16:52:05.496931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1591/2284] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:05 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:05.501033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:05.501630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:05.506963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:05.507444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:05.508250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:05.508689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:05.565901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:05.573477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4de7e73-d0ae-420c-8e6e-fc8deca5a5cb tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075628 Jan 19 16:52:05.574038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1592/2285] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:05 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:05.709887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:05.710491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:05.717337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:05.717786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:05.718556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:05.718995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:05.776054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:05.784192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-afde61a1-9544-45f8-97df-ed0e9eaf99b7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077968 Jan 19 16:52:05.784749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1593/2286] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:06.513554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:06.514233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:06.520444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:06.520888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:06.521649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:06.522098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:06.647466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:06.655327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c1a5720f-0bbc-4080-b990-0da420c01dbc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146008 Jan 19 16:52:06.655924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1594/2287] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:06 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:06.660564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:06.661149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:06.667195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:06.667641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:06.668433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:06.669370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:06.730093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:06.738598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e6864d2b-bc1b-459d-8ad0-605621dcf534 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.081740 Jan 19 16:52:06.739156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1595/2288] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:06 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:06.800435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:06.800969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:06.806685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:06.807141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:06.807941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:06.808383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:06.865646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:06.873931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-51103bce-9a19-4ae7-b915-17166714ca5b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077032 Jan 19 16:52:06.874498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1596/2289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:07.671817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:07.672499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:07.678732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:07.679185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:07.679980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:07.680436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:07.805862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:07.814020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c8764e1e-bdd0-48a4-a1d5-e53fe4fa6ecd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.145958 Jan 19 16:52:07.814591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1597/2290] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:07 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:07.818666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:07.819264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:07.824581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:07.825763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:07.827005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:07.827700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:07.885381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:07.893245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ec7c1b10-482a-45cc-9014-caddd3ab0a8b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077727 Jan 19 16:52:07.893807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1598/2291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:07 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:07.897912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:07.898508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:07.903830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:07.904284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:07.905050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:07.905486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:07.965569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:07.973633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2fb5f67e-520d-43cf-9350-83b7c7354fd8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078909 Jan 19 16:52:07.974191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1599/2292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:08.829981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:08.830593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:08.836873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:08.837330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:08.838109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:08.838548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:08.963771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:08.974637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3edcec21-5fbb-4d7c-a5c6-3d52f83551dc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.148243 Jan 19 16:52:08.975205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1600/2293] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:08 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:08.979752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:08.980356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:08.986799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:08.987290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:08.988105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:08.988542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:09.046576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:09.054282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-064d8f63-b2cf-4e11-90a0-ffd663de65b7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078122 Jan 19 16:52:09.054843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1601/2294] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:08 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:09.059025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:09.059623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:09.065180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:09.065637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:09.066408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:09.066860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:09.123793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:09.131259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-de7a70ef-90a6-4ea9-a622-8eb35c4d77ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.075481 Jan 19 16:52:09.131855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1602/2295] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:09.991215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:09.991886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:09.998732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:09.999202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:09.999994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:10.000427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:10.133287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:10.140904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-94dfdeee-f98c-4afc-9e68-d419537b7e1e tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.153270 Jan 19 16:52:10.141465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1603/2296] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:09 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:10.145564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:10.146145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:10.153515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:10.154102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:10.154873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:10.155308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:10.211979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:10.220291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-82f60829-23a8-4cea-8443-48a4864fc5ab tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.077851 Jan 19 16:52:10.220893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1604/2297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:10 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:10.225084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:10.225680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:10.231059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:10.232169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:10.232932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:10.233370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:10.289687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:10.298167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c2d7dce1-a562-4971-b3f9-e135d1d8034c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.076325 Jan 19 16:52:10.298731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1605/2298] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:11.158745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:11.159346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:11.165889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:11.166338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:11.167104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:11.167540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:11.293853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:11.301671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-430c2c8a-9491-4bef-814e-bb7de57a3c70 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146545 Jan 19 16:52:11.302183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1606/2299] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:11 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:11.306441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:11.307035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:11.312561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:11.313011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:11.313781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:11.314220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:11.375388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:11.383001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8faa5926-ae12-45f3-8b82-5e6cc3588b4a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.079895 Jan 19 16:52:11.383569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1607/2300] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:11 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:11.387851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:11.388450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:11.393765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:11.394215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:11.394980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:11.395417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:11.452333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:11.459884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-681d6b9d-9dea-4d1a-afcf-0cae71836961 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.075270 Jan 19 16:52:11.460443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1608/2301] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:12.318225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:12.318840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:12.325731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:12.326185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:12.326958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:12.327398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:12.453293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:12.461153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0c2dd8cc-a826-4b92-b0e6-ca73cbd30b0c tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146737 Jan 19 16:52:12.461721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1609/2302] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:12 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:12.465917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:12.466518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:12.472089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:12.472548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:12.473317 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:12.473756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:12.530721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:12.538530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fd47d660-fc07-49b9-a8ec-f71a202a1ad7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075800 Jan 19 16:52:12.539012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1610/2303] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:12 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:12.543431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:12.544098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:12.549497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:12.549949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:12.550721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:12.551163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:12.611958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:12.620655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3c3cfaab-8764-49de-ac64-d1b43c5102d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080718 Jan 19 16:52:12.621236 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1611/2304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:13.476979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:13.477617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:13.483946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:13.484402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:13.485221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:13.485659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:13.838063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:13.845817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f18952c4-f479-4257-8edb-7345bdef28c1 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.372507 Jan 19 16:52:13.846391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1612/2305] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:13 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:13.850499 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:13.851097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:13.856412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:13.856872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:13.857643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:13.858082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:13.914535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:13.922462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4b896705-464c-4210-99ba-2db5376bea53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.075130 Jan 19 16:52:13.923034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1613/2306] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:13 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:13.927128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:13.927743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:13.933166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:13.933612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:13.934950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:13.935381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:13.991304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:13.999300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f3b9aaf7-879c-4d46-9bc9-4e3d35b74a87 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.075351 Jan 19 16:52:13.999890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1614/2307] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:14.862136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:14.862769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: eda15853-ef18-40f3-9063-9e714ebd9a12] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:14.868606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:14.869052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:14.869809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:14.870242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:14.997358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:15.004999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fdd14638-2fe2-480d-8c40-3d025aae89e4 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12" status: 200 len: 1557 microversion: 2.1 time: 0.146685 Jan 19 16:52:15.005564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1615/2308] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:14 2022] GET /compute/v2.1/servers/eda15853-ef18-40f3-9063-9e714ebd9a12 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:15.009663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:15.010261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:15.015615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:15.016100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:15.016880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:15.018265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:15.075068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:15.082835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-99bc6cd0-dae0-4f6a-892f-4ec61c08175a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076360 Jan 19 16:52:15.083580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1616/2309] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:15 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:15.087471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:15.088092 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:15.093425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:15.093878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:15.094637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:15.095066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:15.153912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:15.161598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4c5b29bd-52b5-4744-9476-e0bbab063419 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077259 Jan 19 16:52:15.162247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1617/2310] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:16.103436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:16.104180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:16.110467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:16.110918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:16.111696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:16.112153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:16.174325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:16.182241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-96496ad9-be77-42b1-b0c7-12ecbf4f5061 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.083638 Jan 19 16:52:16.182805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1618/2311] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:16 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:16.187556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:16.188226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:16.193936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:16.194390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:16.195204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:16.195640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:16.259238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:16.267392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ef48b645-52fe-483b-92ac-5c01f89eb6ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083639 Jan 19 16:52:16.268005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1619/2312] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:17.199254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:17.199993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:17.206282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:17.206729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:17.207497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:17.207960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:17.266643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:17.274346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-45885383-bc91-4d2b-ba01-456202fa3000 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078766 Jan 19 16:52:17.275034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1620/2313] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:17 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:17.284008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:17.284606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:17.290721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:17.291172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:17.291987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:17.292430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:17.351404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:17.359701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8b05e157-d54b-4227-937b-d90b4840157c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079082 Jan 19 16:52:17.360261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1621/2314] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:18.290339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:18.291017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:18.297148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:18.297597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:18.298359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:18.298790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:18.355769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:18.363254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8f0704c7-519b-4d93-a9e0-0ee20589b5cd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.076823 Jan 19 16:52:18.363835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1622/2315] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:18 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:18.375726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:18.376319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:18.381692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:18.382137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:18.382896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:18.383329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:18.440058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:18.447489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7b8295a2-9ee5-4f23-b930-fd05ca432bac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.074932 Jan 19 16:52:18.448083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1623/2316] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:19.380237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:19.380911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:19.386985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:19.388014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:19.388791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:19.389232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:19.446851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:19.454997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cd41ea56-7af2-4927-9d2e-c83d253b9903 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078465 Jan 19 16:52:19.455512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1624/2317] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:19 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:19.463800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:19.464394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:19.470549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:19.470994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:19.471809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:19.472238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:19.534475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:19.543102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6685ae76-a1ee-49ca-99ab-39e1b84ae48b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082554 Jan 19 16:52:19.543725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1625/2318] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:20.471230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:20.472039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:20.478206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:20.478655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:20.479418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:20.479889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:20.537902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:20.546384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-585a2153-c89b-42cd-9814-29fd8a21e44e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 200 len: 1367 microversion: 2.1 time: 0.078779 Jan 19 16:52:20.546946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1626/2319] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:20 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 1367 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:20.559235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:20.559882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:20.565570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:20.566022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:20.566788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:20.567223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:20.624157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:20.631776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-793ad148-3766-4ac5-9edc-cd8c4537f559 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.075971 Jan 19 16:52:20.632333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1627/2320] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:20.636364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc856259-fff9-4576-b5d5-cfb53f0885a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '.version_select at 0x7f716c122ca0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:20.657319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc856259-fff9-4576-b5d5-cfb53f0885a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748099384" status: 202 len: 0 microversion: 2.1 time: 0.024005 Jan 19 16:52:20.657878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1628/2321] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Jan 19 16:52:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748099384 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:52:21.451983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cfec10cd-a380-47e8-9ed0-351047b43f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'create', calling method: .version_select at 0x7f716c0f09d0>, body: {"keypair": {"name": "tempest-keypair-1649463572"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:21.466105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-cfec10cd-a380-47e8-9ed0-351047b43f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:52:21.470036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-cfec10cd-a380-47e8-9ed0-351047b43f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for user b63c0a1b76904bf5b187743af7e96e2d and project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:52:21.605076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-cfec10cd-a380-47e8-9ed0-351047b43f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:52:21.609284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-cfec10cd-a380-47e8-9ed0-351047b43f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for user b63c0a1b76904bf5b187743af7e96e2d and project 8ba3551993a4479e96ab741b8fe10555. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:52:21.622552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cfec10cd-a380-47e8-9ed0-351047b43f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.174448 Jan 19 16:52:21.623152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1629/2322] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Jan 19 16:52:21 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:21.648390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:21.649116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:21.655804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:21.656292 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:21.657229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:21.657803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:21.720968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:21.729565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7418b5ec-2b65-443e-8268-f4ac1732bf4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.084976 Jan 19 16:52:21.730185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1630/2323] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:22.746193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:22.747346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:22.754084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:22.754531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:22.755309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:22.755760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:22.816199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:22.823899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2cdf85ad-3467-4371-937b-8a83c77fad59 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081419 Jan 19 16:52:22.824455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1631/2324] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:22.829702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1171277484", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e8425d-6018-4090-9ac6-d49f7dfba7bf"}], "security_groups": [{"name": "tempest-securitygroup--761341602"}], "key_name": "tempest-keypair-1649463572", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:22.930653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] validate_networks() for [('34e8425d-6018-4090-9ac6-d49f7dfba7bf', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:52:23.339042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:52:23.339471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:52:23.340739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:52:23.341201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:52:23.341617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:52:23.350062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:23.350519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:23.351335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:23.351803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:23.367616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for project 8ba3551993a4479e96ab741b8fe10555. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:52:23.371559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Getting quotas for user b63c0a1b76904bf5b187743af7e96e2d and project 8ba3551993a4479e96ab741b8fe10555. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:52:23.382181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:52:23.384486 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:52:23.431810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9669aaf1-2a08-4e29-a57e-7bdcdb554c9c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.605717 Jan 19 16:52:23.432821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1632/2325] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:52:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:52:23.442224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e2bdc791-a334-43f5-a135-b034e05640af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:23.442830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e2bdc791-a334-43f5-a135-b034e05640af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:23.494620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e2bdc791-a334-43f5-a135-b034e05640af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:23.501945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e2bdc791-a334-43f5-a135-b034e05640af tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1238 microversion: 2.1 time: 0.063190 Jan 19 16:52:23.502712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1633/2326] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:23 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:23.841196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:23.841981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:23.849216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:23.849672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:23.850447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:23.850888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:23.911275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:23.920324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4c78f75-0964-4f87-89de-26977af37381 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082851 Jan 19 16:52:23.920887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1634/2327] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:24.517849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:24.518462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:24.524267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:24.524720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:24.525496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:24.525930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:24.592137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:24.599306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f3856ef5-5987-496a-a9cb-1e3fe21d7c35 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1296 microversion: 2.1 time: 0.085031 Jan 19 16:52:24.599899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1635/2328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:24 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:24.937238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:24.937958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:24.944463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:24.944947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:24.945776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:24.946197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:25.049528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:25.060773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b98c7f65-39af-4cd3-978f-e313e24c4669 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.126789 Jan 19 16:52:25.061385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1636/2329] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:25.616704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:25.617320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:25.623975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:25.624513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:25.625648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:25.626153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:25.852941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:25.861368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8a089cbb-a77b-473e-a987-97d6fbc9d110 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1363 microversion: 2.1 time: 0.248345 Jan 19 16:52:25.861947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1637/2330] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:25 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:25.866542 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-fc077ad8-6625-44ac-9477-e7a4fa16f12e req-46a3b836-c7e1-4f5f-a510-c51f15f21699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6d642e-934e-484f-91bb-ea63aa4a7ad9", "tag": "8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:25.868495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:52:25.868495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:52:25.877619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-fc077ad8-6625-44ac-9477-e7a4fa16f12e req-46a3b836-c7e1-4f5f-a510-c51f15f21699 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:25.878060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-fc077ad8-6625-44ac-9477-e7a4fa16f12e req-46a3b836-c7e1-4f5f-a510-c51f15f21699 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:25.888943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-fc077ad8-6625-44ac-9477-e7a4fa16f12e req-46a3b836-c7e1-4f5f-a510-c51f15f21699 service nova] Creating event network-changed:8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428 for instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 on hv-cinder-78447 Jan 19 16:52:25.893990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-fc077ad8-6625-44ac-9477-e7a4fa16f12e req-46a3b836-c7e1-4f5f-a510-c51f15f21699 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030680 Jan 19 16:52:25.894588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1638/2331] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:52:26.077100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:26.077786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:26.084259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:26.084714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:26.085492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:26.085927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:26.171359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:26.178972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79e0934a-72d7-4c41-9920-8f7eef179952 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.106006 Jan 19 16:52:26.179536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1639/2332] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:26.877998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:26.878626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:26.884517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:26.884972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:26.885742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:26.886177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:27.013244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:27.020408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f01b1e90-0de6-4316-b6de-f691fbcc58b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1363 microversion: 2.1 time: 0.146092 Jan 19 16:52:27.020978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1640/2333] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:26 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:27.195188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:27.195880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:27.202455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:27.202901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:27.203662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:27.204116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:27.264267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:27.271911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dccb2d78-d4fd-432b-ab78-1a7bde60a46e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080234 Jan 19 16:52:27.272485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1641/2334] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:28.036837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:28.037444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:28.044210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:28.044651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:28.045418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:28.045848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:28.175871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:28.183295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a07415f0-0515-45c3-8e68-01cc8ef0527a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1363 microversion: 2.1 time: 0.149759 Jan 19 16:52:28.184275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1642/2335] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:28 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:28.288169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:28.288762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:28.295844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:28.296334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:28.297131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:28.297574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:28.354379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:28.362616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-827f350d-dbb8-4bf5-8775-6795b38f98b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077865 Jan 19 16:52:28.363174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1643/2336] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:29.200210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:29.200821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:29.206703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:29.207161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:29.207960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:29.208404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:29.338127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:29.345880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-910294eb-6606-4ebc-a6be-e214d7e83867 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1363 microversion: 2.1 time: 0.149832 Jan 19 16:52:29.346450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1644/2337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:29 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:29.378163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:29.378770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:29.384794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:29.385248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:29.386023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:29.386488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:29.445496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:29.453962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2fbb6204-364c-4a5b-b340-10a21e6602e9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079383 Jan 19 16:52:29.454758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1645/2338] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:30.362515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:30.363242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:30.369468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:30.369923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:30.370718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:30.371139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:30.504632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:30.511936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3ca9a164-e977-4741-b11e-ad6e4931dcb0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1363 microversion: 2.1 time: 0.153025 Jan 19 16:52:30.512517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1646/2339] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:30 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:30.516894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:30.517502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:30.524083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:30.524540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:30.525324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:30.525772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:30.584087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:30.592365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c819d335-34c6-4c6b-8ae6-ff0035f9bf76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078888 Jan 19 16:52:30.592928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1647/2340] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:31.504284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-5bd5ad87-0a67-4a14-b6bc-d3fc501fa719 req-2eb533b7-a56a-4fba-802e-fa88b45064ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6d642e-934e-484f-91bb-ea63aa4a7ad9", "name": "network-vif-plugged", "status": "completed", "tag": "8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:31.506067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:52:31.506067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:52:31.514265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-5bd5ad87-0a67-4a14-b6bc-d3fc501fa719 req-2eb533b7-a56a-4fba-802e-fa88b45064ec service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:31.514852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-5bd5ad87-0a67-4a14-b6bc-d3fc501fa719 req-2eb533b7-a56a-4fba-802e-fa88b45064ec service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:31.526361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-5bd5ad87-0a67-4a14-b6bc-d3fc501fa719 req-2eb533b7-a56a-4fba-802e-fa88b45064ec service nova] Creating event network-vif-plugged:8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428 for instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 on hv-cinder-78447 Jan 19 16:52:31.531398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-5bd5ad87-0a67-4a14-b6bc-d3fc501fa719 req-2eb533b7-a56a-4fba-802e-fa88b45064ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085491 Jan 19 16:52:31.532033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1648/2341] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:52:31.536947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:31.537634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:31.544521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:31.544975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:31.545752 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:31.546187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:31.706570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:31.713866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1bfc30bf-4c98-49a7-bf40-12d9561dba8f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1363 microversion: 2.1 time: 0.180684 Jan 19 16:52:31.714433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1649/2342] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:31 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:31.718773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:31.719450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:31.725100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:31.725557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:31.726337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:31.726771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:31.785365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:31.793773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3f3205bc-d7c2-4bdf-88e9-76a15f2307d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077803 Jan 19 16:52:31.794334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1650/2343] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:32.732258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:32.732866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:32.739035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:32.739487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:32.740290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:32.740719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:32.870285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:32.877835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fbd8d0b0-4d0a-466c-ba23-25382321a797 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1363 microversion: 2.1 time: 0.150995 Jan 19 16:52:32.878483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1651/2344] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:32 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:32.882906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:32.883523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:32.889650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:32.890097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:32.890858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:32.891291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:32.952399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:32.959992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-716e1d0c-2ca1-42e9-8665-b2094e51e6ec tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080559 Jan 19 16:52:32.960550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1652/2345] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:33.894800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:33.895463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:33.901729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:33.902181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:33.902950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:33.903386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:34.030239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:34.037422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bd755cd0-32b6-43be-bce7-7a60558da483 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1549 microversion: 2.1 time: 0.146251 Jan 19 16:52:34.037990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1653/2346] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:33 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:34.042385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:34.043569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:34.049034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:34.049497 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:34.050270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:34.050707 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:34.107220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:34.114747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-edde7f37-a736-4c71-bb27-8b30457efd3f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.075836 Jan 19 16:52:34.115309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1654/2347] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:52:34.119554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be7490f2-2a7b-4e04-a114-64c60961b7c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:34.120064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be7490f2-2a7b-4e04-a114-64c60961b7c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:34.125344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be7490f2-2a7b-4e04-a114-64c60961b7c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:34.125794 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be7490f2-2a7b-4e04-a114-64c60961b7c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:34.126565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be7490f2-2a7b-4e04-a114-64c60961b7c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:34.126998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be7490f2-2a7b-4e04-a114-64c60961b7c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:34.204710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be7490f2-2a7b-4e04-a114-64c60961b7c2 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088031 Jan 19 16:52:34.205321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1655/2348] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jan 19 16:52:34 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:52:35.131785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:35.132470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:35.138665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:35.139119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:35.139924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:35.140475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:35.222703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:35.230886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e356dd1a-19d7-4132-a0ea-a6927226672d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.102790 Jan 19 16:52:35.231624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1656/2349] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:35.381777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c1f635bb-b7a5-44f9-9a11-73579eda6c20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:35.382860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c1f635bb-b7a5-44f9-9a11-73579eda6c20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:35.388933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1f635bb-b7a5-44f9-9a11-73579eda6c20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:35.389461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1f635bb-b7a5-44f9-9a11-73579eda6c20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:35.390309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1f635bb-b7a5-44f9-9a11-73579eda6c20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:35.390818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c1f635bb-b7a5-44f9-9a11-73579eda6c20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:35.448339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c1f635bb-b7a5-44f9-9a11-73579eda6c20 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.070091 Jan 19 16:52:35.449016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1657/2350] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:35 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:35.454015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-557acfdf-e021-49da-be0f-9f6fc6f667d3 req-937181f2-aa5f-4b2e-9916-9e41f70363cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6d642e-934e-484f-91bb-ea63aa4a7ad9", "tag": "8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:35.455508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:52:35.455508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:52:35.463424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-557acfdf-e021-49da-be0f-9f6fc6f667d3 req-937181f2-aa5f-4b2e-9916-9e41f70363cf service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:35.463908 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-557acfdf-e021-49da-be0f-9f6fc6f667d3 req-937181f2-aa5f-4b2e-9916-9e41f70363cf service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:35.474896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-557acfdf-e021-49da-be0f-9f6fc6f667d3 req-937181f2-aa5f-4b2e-9916-9e41f70363cf service nova] Creating event network-changed:8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428 for instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 on hv-cinder-78447 Jan 19 16:52:35.480844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-557acfdf-e021-49da-be0f-9f6fc6f667d3 req-937181f2-aa5f-4b2e-9916-9e41f70363cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029573 Jan 19 16:52:35.481441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1658/2351] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:52:36.248406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:36.249134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:36.255891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:36.256354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:36.257149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:36.257597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:36.321056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:36.329715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-31da6739-31a4-4d37-bbeb-2225ed851e85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.085932 Jan 19 16:52:36.330301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1659/2352] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:36.458869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dab54e2a-05ce-4ae1-a313-7a8b7c662b98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:36.459948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dab54e2a-05ce-4ae1-a313-7a8b7c662b98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:36.466185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dab54e2a-05ce-4ae1-a313-7a8b7c662b98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:36.466632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dab54e2a-05ce-4ae1-a313-7a8b7c662b98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:36.467408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dab54e2a-05ce-4ae1-a313-7a8b7c662b98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:36.467880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dab54e2a-05ce-4ae1-a313-7a8b7c662b98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:36.524672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dab54e2a-05ce-4ae1-a313-7a8b7c662b98 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.069273 Jan 19 16:52:36.525677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1660/2353] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:36 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:37.347180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:37.347845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:37.354612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:37.355207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:37.356445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:37.356881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:37.417147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:37.424890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5060c165-a5d1-47df-ae55-1484f7d7d137 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081895 Jan 19 16:52:37.425449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1661/2354] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:37.534974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5305b940-68db-447b-92d8-118b161ba8d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:37.535946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5305b940-68db-447b-92d8-118b161ba8d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:37.542412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5305b940-68db-447b-92d8-118b161ba8d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:37.542869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5305b940-68db-447b-92d8-118b161ba8d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:37.543648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5305b940-68db-447b-92d8-118b161ba8d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:37.544117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5305b940-68db-447b-92d8-118b161ba8d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:37.604745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5305b940-68db-447b-92d8-118b161ba8d6 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.073031 Jan 19 16:52:37.605291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1662/2355] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:37 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:38.441784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:38.442473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:38.449277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:38.449726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:38.450494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:38.450934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:38.509749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:38.517792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cba427d2-9611-4d2d-93ae-957eab38a018 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079984 Jan 19 16:52:38.518353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1663/2356] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:38.615288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-662f223b-b722-43b5-816d-dedc541fd733 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:38.616230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-662f223b-b722-43b5-816d-dedc541fd733 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:38.622560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f223b-b722-43b5-816d-dedc541fd733 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:38.623016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f223b-b722-43b5-816d-dedc541fd733 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:38.623813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f223b-b722-43b5-816d-dedc541fd733 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:38.624258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-662f223b-b722-43b5-816d-dedc541fd733 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:38.683771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-662f223b-b722-43b5-816d-dedc541fd733 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.071286 Jan 19 16:52:38.683919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1664/2357] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:38 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:39.534526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:39.535217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:39.542290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:39.542733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:39.543494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:39.543949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:39.602643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:39.611469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-366598a4-a225-4dc4-8338-460e5130c9a4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080879 Jan 19 16:52:39.612100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1665/2358] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:39.693622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-929d7650-bf05-474f-863e-3c43f923cd2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:39.694571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-929d7650-bf05-474f-863e-3c43f923cd2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:39.700812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-929d7650-bf05-474f-863e-3c43f923cd2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:39.701262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-929d7650-bf05-474f-863e-3c43f923cd2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:39.702031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-929d7650-bf05-474f-863e-3c43f923cd2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:39.702470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-929d7650-bf05-474f-863e-3c43f923cd2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:39.757502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-929d7650-bf05-474f-863e-3c43f923cd2f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.067273 Jan 19 16:52:39.758091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1666/2359] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:39 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:40.628464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:40.629172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:40.636205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:40.637176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:40.637940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:40.638370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:40.697404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:40.706057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4e331b9-f660-4d3d-8a65-79d43f8f20ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081606 Jan 19 16:52:40.706627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1667/2360] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:40.768014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-849ec34f-c18d-4acb-96f9-07ec39eaf447 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:40.768919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-849ec34f-c18d-4acb-96f9-07ec39eaf447 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:40.774875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-849ec34f-c18d-4acb-96f9-07ec39eaf447 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:40.775325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-849ec34f-c18d-4acb-96f9-07ec39eaf447 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:40.776131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-849ec34f-c18d-4acb-96f9-07ec39eaf447 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:40.776568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-849ec34f-c18d-4acb-96f9-07ec39eaf447 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:40.831601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-849ec34f-c18d-4acb-96f9-07ec39eaf447 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.066799 Jan 19 16:52:40.832220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1668/2361] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:40 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:41.723325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:41.723999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:41.731439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:41.731923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:41.732695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:41.733132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:41.796734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:41.804828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1be6b1ab-6cc6-4cfd-af21-dbc9588aa493 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.085516 Jan 19 16:52:41.805391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1669/2362] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:41.842062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a5f343d7-4d0b-4404-9f25-d42e60b94e0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:41.842944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a5f343d7-4d0b-4404-9f25-d42e60b94e0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:41.848488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5f343d7-4d0b-4404-9f25-d42e60b94e0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:41.848936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5f343d7-4d0b-4404-9f25-d42e60b94e0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:41.849695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5f343d7-4d0b-4404-9f25-d42e60b94e0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:41.850131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5f343d7-4d0b-4404-9f25-d42e60b94e0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:41.905379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a5f343d7-4d0b-4404-9f25-d42e60b94e0b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.066969 Jan 19 16:52:41.905975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1670/2363] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:41 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:42.821913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:42.822541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:42.829946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:42.830388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:42.831150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:42.831582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:42.893202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:42.901334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f8d386f8-9d56-4d9b-a747-4d16451bf885 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083466 Jan 19 16:52:42.901901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1671/2364] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:42.916078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-02dbf4b5-7503-4e94-9ec5-5a5a7e6981b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:42.916974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-02dbf4b5-7503-4e94-9ec5-5a5a7e6981b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:42.922490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02dbf4b5-7503-4e94-9ec5-5a5a7e6981b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:42.922940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02dbf4b5-7503-4e94-9ec5-5a5a7e6981b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:42.923730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02dbf4b5-7503-4e94-9ec5-5a5a7e6981b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:42.924172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-02dbf4b5-7503-4e94-9ec5-5a5a7e6981b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:42.979375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-02dbf4b5-7503-4e94-9ec5-5a5a7e6981b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.066692 Jan 19 16:52:42.980025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1672/2365] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:42 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:52:43.920336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:43.921053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:43.927960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:43.928416 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:43.929192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:43.929638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:43.988521 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:43.996698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3f140d61-51d5-48e9-ab44-94c077d2ce89 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081378 Jan 19 16:52:43.997294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1673/2366] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:44.001668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f61196f3-cee3-47c4-a9e7-f14b7ea4d5c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:44.002564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f61196f3-cee3-47c4-a9e7-f14b7ea4d5c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:44.007985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61196f3-cee3-47c4-a9e7-f14b7ea4d5c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:44.008429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61196f3-cee3-47c4-a9e7-f14b7ea4d5c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:44.009201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61196f3-cee3-47c4-a9e7-f14b7ea4d5c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:44.009639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61196f3-cee3-47c4-a9e7-f14b7ea4d5c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:44.064546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f61196f3-cee3-47c4-a9e7-f14b7ea4d5c1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.066044 Jan 19 16:52:44.065136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1674/2367] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:43 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 19 16:52:45.013579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:45.014271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:45.021115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:45.021567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:45.022335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:45.022773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:45.082508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:45.090652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7f8ee22e-4aad-40f1-bbd6-6f5df5a0dff9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081072 Jan 19 16:52:45.091208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1675/2368] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:45.095506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-33aa15d8-ee6a-41d5-8e8a-f52238a8953e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:45.096529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-33aa15d8-ee6a-41d5-8e8a-f52238a8953e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:45.101897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33aa15d8-ee6a-41d5-8e8a-f52238a8953e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:45.102350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33aa15d8-ee6a-41d5-8e8a-f52238a8953e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:45.103119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33aa15d8-ee6a-41d5-8e8a-f52238a8953e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:45.103560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33aa15d8-ee6a-41d5-8e8a-f52238a8953e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:45.172832 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-33aa15d8-ee6a-41d5-8e8a-f52238a8953e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 13107 microversion: 2.1 time: 0.080421 Jan 19 16:52:45.173457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1676/2369] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:45 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 13107 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:46.106593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:46.107275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:46.114026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:46.114473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:46.115232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:46.115661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:46.148177 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:52:46.148762 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:52:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:52:46.179324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:46.187652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d59de4aa-d041-4b0c-bfe4-89fdbddc0b9e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.085084 Jan 19 16:52:46.188235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1677/2370] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:46.192546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bf6f763d-e516-48f7-afac-688d21c1fad9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:46.193438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bf6f763d-e516-48f7-afac-688d21c1fad9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:46.199578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf6f763d-e516-48f7-afac-688d21c1fad9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:46.200073 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf6f763d-e516-48f7-afac-688d21c1fad9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:46.200851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf6f763d-e516-48f7-afac-688d21c1fad9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:46.201294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf6f763d-e516-48f7-afac-688d21c1fad9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:46.272362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bf6f763d-e516-48f7-afac-688d21c1fad9 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 18608 microversion: 2.1 time: 0.082946 Jan 19 16:52:46.272979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1678/2371] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:46 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 18608 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:47.204948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:47.205589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:47.212496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:47.212956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:47.213740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:47.214185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:47.273181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:47.282056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-12996c4b-cab8-4466-ae31-52db8582550b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081187 Jan 19 16:52:47.282621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1679/2372] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:47.286818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-91218295-fbec-4244-b97a-4ca4cfb183c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:47.287731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-91218295-fbec-4244-b97a-4ca4cfb183c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:47.293419 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91218295-fbec-4244-b97a-4ca4cfb183c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:47.293870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91218295-fbec-4244-b97a-4ca4cfb183c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:47.294641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91218295-fbec-4244-b97a-4ca4cfb183c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:47.295081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-91218295-fbec-4244-b97a-4ca4cfb183c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:47.361691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-91218295-fbec-4244-b97a-4ca4cfb183c7 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 19342 microversion: 2.1 time: 0.077823 Jan 19 16:52:47.362343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1680/2373] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:47 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 19342 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:48.300057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:48.300785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:48.307548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:48.308050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:48.308819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:48.309258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:48.370983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:48.379161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-83037f0f-26d5-42c0-a40e-1f20c970e772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083308 Jan 19 16:52:48.379732 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1681/2374] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:48.383999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff86d75d-436d-431c-bcba-cfcf5559f76a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:48.384884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff86d75d-436d-431c-bcba-cfcf5559f76a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:48.390386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff86d75d-436d-431c-bcba-cfcf5559f76a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:48.390828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff86d75d-436d-431c-bcba-cfcf5559f76a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:48.391649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff86d75d-436d-431c-bcba-cfcf5559f76a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:48.392104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff86d75d-436d-431c-bcba-cfcf5559f76a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:48.460533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff86d75d-436d-431c-bcba-cfcf5559f76a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 22113 microversion: 2.1 time: 0.079623 Jan 19 16:52:48.461148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1682/2375] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:48 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 22113 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:49.395365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:49.396094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:49.402973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:49.403428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:49.404245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:49.404685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:49.464123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:49.472726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c8d0a4d-953e-4277-a36e-e4444b406b9c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081336 Jan 19 16:52:49.473300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1683/2376] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:49.477649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-48a8b295-da92-4671-9a35-bb0cc6420f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:49.478549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-48a8b295-da92-4671-9a35-bb0cc6420f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:49.484844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48a8b295-da92-4671-9a35-bb0cc6420f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:49.485296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48a8b295-da92-4671-9a35-bb0cc6420f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:49.486203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48a8b295-da92-4671-9a35-bb0cc6420f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:49.486644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48a8b295-da92-4671-9a35-bb0cc6420f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:49.561965 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-48a8b295-da92-4671-9a35-bb0cc6420f23 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 23798 microversion: 2.1 time: 0.087367 Jan 19 16:52:49.562766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1684/2377] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:49 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 23798 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:50.490001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:50.490690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:50.498114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:50.498568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:50.499340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:50.499805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:50.560931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:50.569212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fc9f259c-a5c1-44c1-9266-866d8c8eaf70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083189 Jan 19 16:52:50.569770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1685/2378] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:50.574102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ab3de91a-c187-4c77-baaf-632f3391ea64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:50.575641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ab3de91a-c187-4c77-baaf-632f3391ea64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:50.581254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3de91a-c187-4c77-baaf-632f3391ea64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:50.581705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3de91a-c187-4c77-baaf-632f3391ea64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:50.582475 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3de91a-c187-4c77-baaf-632f3391ea64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:50.582918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ab3de91a-c187-4c77-baaf-632f3391ea64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:50.650482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ab3de91a-c187-4c77-baaf-632f3391ea64 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 25389 microversion: 2.1 time: 0.079494 Jan 19 16:52:50.651118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1686/2379] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:50 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 25389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:51.586605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:51.587293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:51.594822 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:51.595271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:51.596079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:51.596519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:51.655120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:51.663280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-702a884d-e976-4671-a5bf-958e5838369e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080712 Jan 19 16:52:51.663868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1687/2380] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:51.668479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9b588434-2e40-4dbd-9627-11f65fcf056c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:51.669368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9b588434-2e40-4dbd-9627-11f65fcf056c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:51.674680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b588434-2e40-4dbd-9627-11f65fcf056c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:51.675140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b588434-2e40-4dbd-9627-11f65fcf056c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:51.675941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b588434-2e40-4dbd-9627-11f65fcf056c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:51.676374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9b588434-2e40-4dbd-9627-11f65fcf056c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:51.757572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9b588434-2e40-4dbd-9627-11f65fcf056c tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 26884 microversion: 2.1 time: 0.092476 Jan 19 16:52:51.758194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1688/2381] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:51 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 26884 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:52.680513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:52.681322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:52.688856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:52.689303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:52.690079 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:52.690549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:52.749377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:52.757363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f67e035d-7439-48ea-a7b7-85b3c6e99ddf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080899 Jan 19 16:52:52.757917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1689/2382] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:52.767999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-959ad23d-2c33-4a96-912e-d0e35012e98a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:52.768911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-959ad23d-2c33-4a96-912e-d0e35012e98a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:52.774435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-959ad23d-2c33-4a96-912e-d0e35012e98a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:52.774880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-959ad23d-2c33-4a96-912e-d0e35012e98a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:52.775638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-959ad23d-2c33-4a96-912e-d0e35012e98a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:52.776093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-959ad23d-2c33-4a96-912e-d0e35012e98a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:52.853403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-959ad23d-2c33-4a96-912e-d0e35012e98a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 27728 microversion: 2.1 time: 0.088550 Jan 19 16:52:52.854342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1690/2383] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:52 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 27728 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:52:53.774223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:53.774926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:53.781800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:53.782256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:53.783028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:53.783466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:53.846114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:53.854287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8408e1d4-f1a3-486f-9e8a-5559e27fe391 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.084074 Jan 19 16:52:53.854852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1691/2384] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:53.864809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c854984a-1812-4340-8b5a-55f23280e492 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:53.865704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c854984a-1812-4340-8b5a-55f23280e492 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:53.871174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c854984a-1812-4340-8b5a-55f23280e492 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:53.872323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c854984a-1812-4340-8b5a-55f23280e492 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:53.873103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c854984a-1812-4340-8b5a-55f23280e492 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:53.873546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c854984a-1812-4340-8b5a-55f23280e492 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:53.944190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c854984a-1812-4340-8b5a-55f23280e492 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 28206 microversion: 2.1 time: 0.082364 Jan 19 16:52:53.944744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1692/2385] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:53 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 28206 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:52:54.871338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:54.872046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:54.878880 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:54.879333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:54.880133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:54.880572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:54.945212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:54.954444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-122bda79-0cf3-407e-beb4-a51043235c7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.087158 Jan 19 16:52:54.955003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1693/2386] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:54.959215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff339c6a-2a8f-48e1-94e3-9e4bb98cac94 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:54.960118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff339c6a-2a8f-48e1-94e3-9e4bb98cac94 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:54.966070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff339c6a-2a8f-48e1-94e3-9e4bb98cac94 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:54.966512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff339c6a-2a8f-48e1-94e3-9e4bb98cac94 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:54.967265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff339c6a-2a8f-48e1-94e3-9e4bb98cac94 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:54.967713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff339c6a-2a8f-48e1-94e3-9e4bb98cac94 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:55.025277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff339c6a-2a8f-48e1-94e3-9e4bb98cac94 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 28206 microversion: 2.1 time: 0.069116 Jan 19 16:52:55.025912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1694/2387] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:54 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 28206 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:55.971943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:55.972671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:55.979250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:55.979744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:55.980531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:55.981577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:56.041696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:56.050097 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b6640a70-285a-4057-a046-8d958103095d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082188 Jan 19 16:52:56.050668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1695/2388] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:56.055024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d33d1d93-80de-4c13-a3fc-4fcf95878c53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:56.055942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d33d1d93-80de-4c13-a3fc-4fcf95878c53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:56.061367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d33d1d93-80de-4c13-a3fc-4fcf95878c53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:56.061821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d33d1d93-80de-4c13-a3fc-4fcf95878c53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:56.062596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d33d1d93-80de-4c13-a3fc-4fcf95878c53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:56.063040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d33d1d93-80de-4c13-a3fc-4fcf95878c53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:56.132572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d33d1d93-80de-4c13-a3fc-4fcf95878c53 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 28496 microversion: 2.1 time: 0.080740 Jan 19 16:52:56.133190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1696/2389] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:56 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 28496 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:57.067053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:57.067784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:57.075328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:57.075811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:57.076594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:57.077031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:57.135696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:57.144333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bbaa67db-cc39-4a52-be60-64b889658f0d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081252 Jan 19 16:52:57.144843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1697/2390] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:57.149044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3afa9bf0-9fc9-4491-bf06-0420f9772e45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:57.149934 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3afa9bf0-9fc9-4491-bf06-0420f9772e45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:57.156008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3afa9bf0-9fc9-4491-bf06-0420f9772e45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:57.156461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3afa9bf0-9fc9-4491-bf06-0420f9772e45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:57.157226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3afa9bf0-9fc9-4491-bf06-0420f9772e45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:57.157660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3afa9bf0-9fc9-4491-bf06-0420f9772e45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:57.229683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3afa9bf0-9fc9-4491-bf06-0420f9772e45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 28664 microversion: 2.1 time: 0.083699 Jan 19 16:52:57.230290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1698/2391] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:57 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 28664 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:58.160746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:58.161445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:58.169251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:58.169703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:58.170479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:58.170920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:58.229225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:58.238014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-37ddf987-1861-4985-92ba-497331df5a01 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081322 Jan 19 16:52:58.238579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1699/2392] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:58.242947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-88ee8892-c3ea-4eb1-9b68-3a17124143a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:58.243887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-88ee8892-c3ea-4eb1-9b68-3a17124143a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:58.249383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88ee8892-c3ea-4eb1-9b68-3a17124143a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:58.249868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88ee8892-c3ea-4eb1-9b68-3a17124143a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:58.250642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88ee8892-c3ea-4eb1-9b68-3a17124143a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:58.251082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-88ee8892-c3ea-4eb1-9b68-3a17124143a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:58.308101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-88ee8892-c3ea-4eb1-9b68-3a17124143a1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 28664 microversion: 2.1 time: 0.068277 Jan 19 16:52:58.308712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1700/2393] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:58 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 28664 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:52:59.254472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:52:59.255157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:59.261952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:59.262396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:59.263155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:59.263584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:59.324116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:52:59.332202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09d92eff-5684-4b49-a097-84826f098733 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081679 Jan 19 16:52:59.332749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1701/2394] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:52:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:52:59.337051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-95f49f3d-e7ed-46f2-98fc-26bf6e46770b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:52:59.337931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-95f49f3d-e7ed-46f2-98fc-26bf6e46770b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:52:59.343309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95f49f3d-e7ed-46f2-98fc-26bf6e46770b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:59.343790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95f49f3d-e7ed-46f2-98fc-26bf6e46770b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:59.344552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95f49f3d-e7ed-46f2-98fc-26bf6e46770b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:52:59.344984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-95f49f3d-e7ed-46f2-98fc-26bf6e46770b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:52:59.402285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-95f49f3d-e7ed-46f2-98fc-26bf6e46770b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 28664 microversion: 2.1 time: 0.068345 Jan 19 16:52:59.402937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1702/2395] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:52:59 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 28664 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:00.347985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:00.348696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:00.355479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:00.355950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:00.356717 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:00.357150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:00.415996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:00.424126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-665e5c90-2157-4179-b0e3-486f890017a5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080082 Jan 19 16:53:00.424681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1703/2396] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:00.428954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40e59058-0527-4a84-ac66-05121bf8abed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:00.429837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40e59058-0527-4a84-ac66-05121bf8abed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:00.435657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e59058-0527-4a84-ac66-05121bf8abed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:00.436131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e59058-0527-4a84-ac66-05121bf8abed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:00.436890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e59058-0527-4a84-ac66-05121bf8abed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:00.437323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e59058-0527-4a84-ac66-05121bf8abed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:00.519510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40e59058-0527-4a84-ac66-05121bf8abed tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 29620 microversion: 2.1 time: 0.093572 Jan 19 16:53:00.520223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1704/2397] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:00 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 29620 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:01.441071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:01.441709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:01.448534 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:01.448979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:01.449741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:01.450175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:01.512998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:01.521247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-af1571a0-06c8-4a7b-8b7a-7440e21a1ec6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.084120 Jan 19 16:53:01.521817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1705/2398] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:01.529783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-22c730f0-30df-45e2-b45c-eb498037ab82 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:01.530688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-22c730f0-30df-45e2-b45c-eb498037ab82 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:01.536370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22c730f0-30df-45e2-b45c-eb498037ab82 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:01.536866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22c730f0-30df-45e2-b45c-eb498037ab82 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:01.537628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22c730f0-30df-45e2-b45c-eb498037ab82 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:01.538067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-22c730f0-30df-45e2-b45c-eb498037ab82 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:01.613351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-22c730f0-30df-45e2-b45c-eb498037ab82 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 31887 microversion: 2.1 time: 0.086772 Jan 19 16:53:01.613978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1706/2399] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:01 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 31887 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:53:02.538631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:02.539313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:02.546501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:02.546931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:02.547721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:02.548161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:02.607157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:02.615144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-89c12889-53a5-4b54-9681-03287c01d755 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080543 Jan 19 16:53:02.615846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1707/2400] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:02.624581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-932f4aa0-f5df-4881-838e-1283b377da1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:02.625477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-932f4aa0-f5df-4881-838e-1283b377da1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:02.630927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-932f4aa0-f5df-4881-838e-1283b377da1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:02.631376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-932f4aa0-f5df-4881-838e-1283b377da1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:02.632168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-932f4aa0-f5df-4881-838e-1283b377da1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:02.632604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-932f4aa0-f5df-4881-838e-1283b377da1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:02.701225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-932f4aa0-f5df-4881-838e-1283b377da1e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 33378 microversion: 2.1 time: 0.080188 Jan 19 16:53:02.701866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1708/2401] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:02 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 33378 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 19 16:53:03.632949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:03.633681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:03.641118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:03.641576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:03.642353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:03.642792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:03.704619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:03.712291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1968d3e9-6f24-4320-9d40-779adc427d22 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083487 Jan 19 16:53:03.712856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1709/2402] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:03.717672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-760df952-60ca-4043-beaf-5312d80e9ea3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:03.718554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-760df952-60ca-4043-beaf-5312d80e9ea3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:03.723793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-760df952-60ca-4043-beaf-5312d80e9ea3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:03.724240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-760df952-60ca-4043-beaf-5312d80e9ea3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:03.724999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-760df952-60ca-4043-beaf-5312d80e9ea3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:03.725433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-760df952-60ca-4043-beaf-5312d80e9ea3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:03.794338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-760df952-60ca-4043-beaf-5312d80e9ea3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 34450 microversion: 2.1 time: 0.080332 Jan 19 16:53:03.794962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1710/2403] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:03 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 34450 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:04.729786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:04.730489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:04.738027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:04.738479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:04.739254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:04.739706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:04.799453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:04.807812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1222a260-0b6f-463c-a02b-bffce142011b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082025 Jan 19 16:53:04.808370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1711/2404] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:04.812945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-766b7421-b039-4451-b8bd-ff4b50bd45b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:04.813854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-766b7421-b039-4451-b8bd-ff4b50bd45b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:04.819956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-766b7421-b039-4451-b8bd-ff4b50bd45b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:04.820412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-766b7421-b039-4451-b8bd-ff4b50bd45b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:04.821192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-766b7421-b039-4451-b8bd-ff4b50bd45b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:04.821627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-766b7421-b039-4451-b8bd-ff4b50bd45b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:04.891369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-766b7421-b039-4451-b8bd-ff4b50bd45b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 35644 microversion: 2.1 time: 0.081841 Jan 19 16:53:04.892294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1712/2405] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:04 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 35644 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:05.828386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:05.829124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:05.835962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:05.836412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:05.837177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:05.837610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:05.896088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:05.904369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5f2d4816-a2c9-42d8-8f24-f6647d4da907 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080530 Jan 19 16:53:05.904920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1713/2406] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:05.909140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bc15682c-e3cf-4fc2-96fc-356246679ed3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:05.910029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bc15682c-e3cf-4fc2-96fc-356246679ed3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:05.916167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc15682c-e3cf-4fc2-96fc-356246679ed3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:05.916615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc15682c-e3cf-4fc2-96fc-356246679ed3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:05.917376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc15682c-e3cf-4fc2-96fc-356246679ed3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:05.917804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bc15682c-e3cf-4fc2-96fc-356246679ed3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:05.985428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bc15682c-e3cf-4fc2-96fc-356246679ed3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 37283 microversion: 2.1 time: 0.079308 Jan 19 16:53:05.986090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1714/2407] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:05 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 37283 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:06.922077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:06.922778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:06.929684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:06.930139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:06.930952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:06.931396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:06.992269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:07.000140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-614dc46a-67ad-4c09-b98c-eaf288160c7b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082557 Jan 19 16:53:07.000714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1715/2408] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:07.004931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dd3159d9-8d55-4447-ae30-0159219f3409 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:07.005828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dd3159d9-8d55-4447-ae30-0159219f3409 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:07.011215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd3159d9-8d55-4447-ae30-0159219f3409 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:07.011669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd3159d9-8d55-4447-ae30-0159219f3409 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:07.012498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd3159d9-8d55-4447-ae30-0159219f3409 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:07.012942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd3159d9-8d55-4447-ae30-0159219f3409 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:07.081062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dd3159d9-8d55-4447-ae30-0159219f3409 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 38199 microversion: 2.1 time: 0.079121 Jan 19 16:53:07.081724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1716/2409] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:07 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 38199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:08.017687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:08.018407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:08.025290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:08.025748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:08.026527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:08.026968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:08.091720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:08.099982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-90d84df6-4b07-4274-8d49-ca1b49f198c9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.086293 Jan 19 16:53:08.100550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1717/2410] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:08.104818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d2530be5-37db-4446-a32e-18c6720dc84f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:08.105703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d2530be5-37db-4446-a32e-18c6720dc84f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:08.111556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2530be5-37db-4446-a32e-18c6720dc84f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:08.112061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2530be5-37db-4446-a32e-18c6720dc84f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:08.112834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2530be5-37db-4446-a32e-18c6720dc84f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:08.113273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2530be5-37db-4446-a32e-18c6720dc84f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:08.171590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d2530be5-37db-4446-a32e-18c6720dc84f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 38199 microversion: 2.1 time: 0.069821 Jan 19 16:53:08.172252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1718/2411] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:08 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 38199 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:09.117100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:09.117784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:09.124624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:09.125068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:09.125831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:09.126265 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:09.185508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:09.193646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2b153e46-ef90-487f-af8e-252f82c89ae9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080464 Jan 19 16:53:09.194201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1719/2412] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:09.198495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e705a01c-6eee-4866-90d1-1bbc5da23ed0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:09.199391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e705a01c-6eee-4866-90d1-1bbc5da23ed0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:09.207142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e705a01c-6eee-4866-90d1-1bbc5da23ed0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:09.207592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e705a01c-6eee-4866-90d1-1bbc5da23ed0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:09.208601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e705a01c-6eee-4866-90d1-1bbc5da23ed0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:09.209041 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e705a01c-6eee-4866-90d1-1bbc5da23ed0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:09.270344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e705a01c-6eee-4866-90d1-1bbc5da23ed0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 38199 microversion: 2.1 time: 0.074975 Jan 19 16:53:09.270980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1720/2413] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:09 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 38199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:10.210446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:10.211134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:10.218471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:10.218919 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:10.219693 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:10.220138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:10.278855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:10.286905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f764cb3e-87ec-4095-a3ea-87ed345a3150 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080352 Jan 19 16:53:10.287460 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1721/2414] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:10.292022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-beff77c6-9778-46f2-a19f-345b3b9920b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:10.292905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-beff77c6-9778-46f2-a19f-345b3b9920b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:10.298853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-beff77c6-9778-46f2-a19f-345b3b9920b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:10.299298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-beff77c6-9778-46f2-a19f-345b3b9920b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:10.300105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-beff77c6-9778-46f2-a19f-345b3b9920b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:10.300540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-beff77c6-9778-46f2-a19f-345b3b9920b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:10.357399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-beff77c6-9778-46f2-a19f-345b3b9920b4 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 38199 microversion: 2.1 time: 0.068725 Jan 19 16:53:10.358039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1722/2415] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:10 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 38199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:11.304151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:11.304851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:11.311728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:11.312190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:11.312970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:11.313413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:11.372670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:11.380930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-838e727d-b0e3-4118-9d4d-96c4273d22de tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080896 Jan 19 16:53:11.381488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1723/2416] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:11.385810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40e19c45-d779-4f14-9f52-3aa6d2f0c717 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:53:11.386703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-40e19c45-d779-4f14-9f52-3aa6d2f0c717 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:11.392809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e19c45-d779-4f14-9f52-3aa6d2f0c717 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:11.393262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e19c45-d779-4f14-9f52-3aa6d2f0c717 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:11.394039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e19c45-d779-4f14-9f52-3aa6d2f0c717 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:11.394505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-40e19c45-d779-4f14-9f52-3aa6d2f0c717 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:11.464161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40e19c45-d779-4f14-9f52-3aa6d2f0c717 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action" status: 200 len: 38330 microversion: 2.1 time: 0.081340 Jan 19 16:53:11.464834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1724/2417] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 16:53:11 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/action => generated 38330 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 19 16:53:11.474330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2c63ebbb-64af-405a-a716-3313d858ad0f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:11.474910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2c63ebbb-64af-405a-a716-3313d858ad0f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:11.481960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c63ebbb-64af-405a-a716-3313d858ad0f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:11.482407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c63ebbb-64af-405a-a716-3313d858ad0f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:11.483168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c63ebbb-64af-405a-a716-3313d858ad0f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:11.483600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2c63ebbb-64af-405a-a716-3313d858ad0f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:11.508447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2c63ebbb-64af-405a-a716-3313d858ad0f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/ips" status: 200 len: 146 microversion: 2.1 time: 0.037768 Jan 19 16:53:11.509183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1725/2418] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jan 19 16:53:11 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:53:12.084116 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:53:12.084698 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:53:12.397783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:12.398316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:12.404664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:12.405116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:12.405882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:12.406321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:12.465860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:12.473886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff3c65f6-feb3-4261-809b-a540a59e6a63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079786 Jan 19 16:53:12.474444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1726/2419] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:12.578595 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:53:12.578780 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:53:13.490084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:13.490706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:13.497987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:13.498442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:13.499255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:13.499713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:13.562889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:13.571104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-68a404c1-9c2a-491d-b021-270a413d6b24 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.084618 Jan 19 16:53:13.571703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1727/2420] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:14.588425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:14.589138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:14.595887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:14.596342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:14.597121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:14.597561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:14.661596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:14.670318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-28678e4d-93fb-4706-a2be-9373d67be4dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.085605 Jan 19 16:53:14.670882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1728/2421] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:15.686769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:15.687424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:15.693747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:15.694202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:15.694977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:15.695417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:15.753444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:15.761118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d0c854b7-1dd5-4f92-95d4-657b6e7e8878 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078636 Jan 19 16:53:15.761687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1729/2422] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:16.777457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:16.778593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:16.784894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:16.785348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:16.786125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:16.786565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:16.844601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:16.852235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-114ffce6-eb0d-4943-94d9-211729be0c45 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078452 Jan 19 16:53:16.852800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1730/2423] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:17.869790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:17.870428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:17.877491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:17.877935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:17.878690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:17.879121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:17.938582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:17.946094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b2654eac-8159-4c5b-ab5c-7561a58f374e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080582 Jan 19 16:53:17.946658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1731/2424] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:18.962547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:18.963213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:18.969462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:18.969912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:18.970685 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:18.971126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:19.028637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:19.036289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-87efe824-4c36-4afa-bd8e-153996ebd9f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077400 Jan 19 16:53:19.037350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1732/2425] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:20.053755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:20.054435 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:20.061138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:20.061586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:20.062351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:20.062782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:20.119909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:20.128060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-efb4cf57-034f-4776-8908-944edb92feff tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078253 Jan 19 16:53:20.128646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1733/2426] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:21.144207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:21.144825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:21.151117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:21.151574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:21.152387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:21.153469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:21.214052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:21.221682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d59e5ca1-484d-4513-9111-b092a67bc537 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081135 Jan 19 16:53:21.222264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1734/2427] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:22.237926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:22.238601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:22.244809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:22.245258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:22.246029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:22.246465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:22.304066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:22.312313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8c921b94-6f0b-44f4-bc81-d575091deb10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078061 Jan 19 16:53:22.312877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1735/2428] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:23.328604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:23.329294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:23.335538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:23.335976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:23.336753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:23.337205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:23.394484 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:23.402224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d57a7f1a-d690-404a-b9d0-b8563298e71b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077302 Jan 19 16:53:23.402791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1736/2429] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:24.418953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:24.419597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:24.425947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:24.426407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:24.427188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:24.427629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:24.485664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:24.493688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a713e304-7929-4bea-ade2-55f7937d9b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078614 Jan 19 16:53:24.494286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1737/2430] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:25.510024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:25.510730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:25.517010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:25.517464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:25.518243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:25.518684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:25.578400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:25.586327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4c375eef-17b1-46a4-a221-01576df46c07 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079986 Jan 19 16:53:25.586892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1738/2431] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:26.602244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:26.602843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:26.609118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:26.609565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:26.610361 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:26.610801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:26.669392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:26.678381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-72e0ad0f-6959-49fa-9707-dd84b50d9d03 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080041 Jan 19 16:53:26.679183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1739/2432] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:27.695453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:27.696096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:27.702884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:27.703343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:27.704161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:27.704605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:27.765082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:27.774400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f319cadf-ac65-42cb-bf9b-9442026f6719 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082577 Jan 19 16:53:27.774969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1740/2433] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:28.791786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:28.792404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:28.799272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:28.799774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:28.800556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:28.801000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:28.858533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:28.866152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ad18516-2402-4f2c-ac13-99a0febce358 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078413 Jan 19 16:53:28.866723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1741/2434] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:29.881641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:29.882273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:29.888591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:29.889036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:29.889796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:29.890225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:29.947746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:29.955298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ad1dfffa-5d0b-45d4-bed8-358657aeaaf8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077303 Jan 19 16:53:29.955890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1742/2435] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:30.970688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:30.971384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:30.977686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:30.978138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:30.978915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:30.979353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:31.036844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:31.044790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1dad4d9a-87b0-4ac2-baf7-423af06b261c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077808 Jan 19 16:53:31.045360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1743/2436] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:32.061213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:32.061865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:32.068067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:32.068512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:32.069271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:32.069700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:32.129848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:32.137530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8d485e91-da57-4af2-9748-51893537bf9d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079957 Jan 19 16:53:32.138086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1744/2437] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:33.154495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:33.155638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:33.161871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:33.162316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:33.163075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:33.163501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:33.222778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:33.230403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d83ca2eb-9bb6-477b-952d-142fc728d982 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079515 Jan 19 16:53:33.230971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1745/2438] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:34.247345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:34.248056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:34.254160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:34.254604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:34.255370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:34.255835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:34.317311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:34.324953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9a694960-e983-4f50-be38-7f290741a6eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081247 Jan 19 16:53:34.325520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1746/2439] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:35.341672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:35.342369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:35.348573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:35.349027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:35.349808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:35.350250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:35.408203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:35.416137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ffc17b6-9328-45fb-a2e3-0c9966ebacaa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078074 Jan 19 16:53:35.416705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1747/2440] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:36.433350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:36.434042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:36.441176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:36.441631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:36.442409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:36.442855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:36.501990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:36.509687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-715bde81-9d1c-4810-bfd3-589fcce05d81 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080132 Jan 19 16:53:36.510250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1748/2441] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:37.526032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:37.526708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:37.532931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:37.533400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:37.534163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:37.534603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:37.592682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:37.600767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1f2bdfbb-1c5e-4afe-a987-6e74ad35fa69 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078390 Jan 19 16:53:37.601330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1749/2442] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:38.617957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:38.618720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:38.624849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:38.625825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:38.626604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:38.627045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:38.684898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:38.693276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c272f94d-6284-49d1-9a37-24be1c0e1891 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079038 Jan 19 16:53:38.693841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1750/2443] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:39.709938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:39.710579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:39.716870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:39.717323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:39.718091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:39.718530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:39.777651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:39.786741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f49baade-6b0c-4020-be6b-1dcdc185753c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080422 Jan 19 16:53:39.787307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1751/2444] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:40.804051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:40.804672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:40.811088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:40.811541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:40.812341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:40.812771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:40.874194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:40.881808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b403360a-2717-446d-b7a2-2903a602c486 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081641 Jan 19 16:53:40.882400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1752/2445] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:41.898189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:41.898815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:41.905081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:41.905523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:41.906285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:41.906718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:41.964340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:41.972056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fedee4ca-06c6-49f6-b384-21b130997484 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077480 Jan 19 16:53:41.972605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1753/2446] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:42.988617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:42.989284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:42.995493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:42.996341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:42.997123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:42.997573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:43.055770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:43.063892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d2487c94-4061-4c7d-a7e9-6d6506643a30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079203 Jan 19 16:53:43.064454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1754/2447] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:44.080150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:44.080797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:44.086976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:44.087431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:44.088255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:44.088726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:44.147356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:44.154948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-62d42319-c325-45e2-b63d-7e01604b2a4c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078475 Jan 19 16:53:44.155510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1755/2448] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:45.171230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:45.171876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:45.177878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:45.178330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:45.179101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:45.179545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:45.236418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:45.243937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fafc5347-e2ff-49b2-859e-950a06177cbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.076300 Jan 19 16:53:45.244511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1756/2449] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:46.260749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:46.261423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:46.268450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:46.268914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:46.269695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:46.270138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:46.327610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:46.335760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b84c6516-221b-4820-a99b-f2fb3a2a275f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078660 Jan 19 16:53:46.336335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1757/2450] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:47.353779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:47.354444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:47.360917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:47.361420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:47.362210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:47.362653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:47.428353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:47.436210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3f191e80-120c-4454-b378-27e82ba741a2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.086370 Jan 19 16:53:47.436782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1758/2451] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:53:48.452425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:48.453109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:48.459204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:48.459648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:48.460468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:48.460900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:48.521970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:48.529897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c657761e-162d-4896-b532-39bcd46126fb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081093 Jan 19 16:53:48.530474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1759/2452] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:53:49.545862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:49.546539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:49.553436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:49.553889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:49.554660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:49.555104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:49.612855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:49.620601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ec458d83-5f76-4452-ae57-73cb72ca6dee tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078445 Jan 19 16:53:49.621173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1760/2453] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:50.636672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:50.637267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:50.644437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:50.645019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:50.645855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:50.646297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:50.722686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:50.730425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f58955d1-12b2-46cf-8a98-b61b7651224f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.097429 Jan 19 16:53:50.731000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1761/2454] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:51.747231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:51.747849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:51.754108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:51.754566 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:51.755348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:51.755821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:51.814352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:51.822663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-23f0c5e1-484a-4967-824d-cd1b05907204 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079114 Jan 19 16:53:51.823232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1762/2455] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:52.839268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:52.839937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:52.846829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:52.847279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:52.848082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:52.848523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:52.907466 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:52.916161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a39111c8-0362-42c6-99b1-e3747d43bcf3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080587 Jan 19 16:53:52.916724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1763/2456] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:53.932590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:53.933294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:53.940102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:53.940553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:53.941318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:53.941750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:54.004087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:54.011636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7817f9c6-9bc5-4a97-a782-84ff39a80a71 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082734 Jan 19 16:53:54.012222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1764/2457] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:55.028008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:55.028702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:55.034921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:55.035373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:55.036175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:55.036614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:55.097631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:55.105868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-76ac34b5-0541-4cba-8c0a-481977dc19cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081439 Jan 19 16:53:55.106438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1765/2458] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:56.122106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:56.122780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:56.129643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:56.130094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:56.130865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:56.131306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:56.188599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:56.196979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3d9de694-0356-4b5e-854f-aa8a1268de08 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078541 Jan 19 16:53:56.197561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1766/2459] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:57.213232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:57.213837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:57.220178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:57.220628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:57.222054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:57.222491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:57.279234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:57.287474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3789956e-cfd8-4e6f-971d-40ed95802586 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077863 Jan 19 16:53:57.288064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1767/2460] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:58.305281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:58.305923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:58.312318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:58.312774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:58.313549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:58.313989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:58.371251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:58.378986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-92fb8969-8ccf-44b3-8753-d42040357029 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077474 Jan 19 16:53:58.379553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1768/2461] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:53:59.396030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:53:59.396639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:53:59.402933 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:59.403389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:59.404205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:53:59.404646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:53:59.462297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:53:59.470000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8d2a1455-92af-40be-a349-a69287b043d2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078335 Jan 19 16:53:59.470567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1769/2462] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:53:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:00.470218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:00.470861 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:00.478474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.478927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.481201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.481201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.507543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:54:00.600131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3474f4c1-4e51-480c-99b5-6d6a28f48919 tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 204 len: 0 microversion: 2.1 time: 0.133564 Jan 19 16:54:00.601043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1770/2463] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:54:00 2022] DELETE /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:54:00.607528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:00.608280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:00.614718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.615180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.615998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.616444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.680814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:00.689297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c708f58a-4b53-423f-bf7f-740bc14b20b0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.087359 Jan 19 16:54:00.689902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1771/2464] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:54:00.698563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:00.698563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:00.700171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.700619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.701398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.701836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.716013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 could not be found. Jan 19 16:54:00.716013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:54:00.716917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-05d80747-ea7f-4ff1-aca8-d4a8d3cb1d76 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 404 len: 111 microversion: 2.20 time: 0.026018 Jan 19 16:54:00.717766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1772/2465] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jan 19 16:54:00 2022] DELETE /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:54:00.722491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:00.723094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:00.729296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.729803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.730683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.731122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.870589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b66fbdfc39840b2962c8d7686098903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3597b29cd8f14493bb90b292c67caf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:00.879081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c96ae2b6-c3bd-41ac-95f5-dc8f906487df tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 200 len: 1514 microversion: 2.1 time: 0.160580 Jan 19 16:54:00.879645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1773/2466] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:00 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:54:00.884027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:00.884612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: bacafabf-ccad-4e5d-bba3-6f72e63b6162] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:00.896393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.896998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.897940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:00.898451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:00.915034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 could not be found. Jan 19 16:54:00.915894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance bacafabf-ccad-4e5d-bba3-6f72e63b6162 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:54:00.916812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-85b2f8ba-cf0b-44dc-bca3-67ad2710f470 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162" status: 404 len: 111 microversion: 2.20 time: 0.036182 Jan 19 16:54:00.917449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1774/2467] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:54:00 2022] GET /compute/v2.1/servers/bacafabf-ccad-4e5d-bba3-6f72e63b6162 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:54:01.452976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-f8c59c30-b49e-45a0-910f-a5352eccf1c1 req-3679d7ff-aad1-4861-aea4-ff1821ae9931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8891777-99d7-4d44-a6a7-60945ddd6ab2", "name": "network-vif-deleted", "tag": "0160ed4b-3862-429e-ab13-5d108761ef8f"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:54:01.454700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:54:01.454700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:54:01.462589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-f8c59c30-b49e-45a0-910f-a5352eccf1c1 req-3679d7ff-aad1-4861-aea4-ff1821ae9931 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:01.463026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-f8c59c30-b49e-45a0-910f-a5352eccf1c1 req-3679d7ff-aad1-4861-aea4-ff1821ae9931 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:01.474441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-f8c59c30-b49e-45a0-910f-a5352eccf1c1 req-3679d7ff-aad1-4861-aea4-ff1821ae9931 service nova] Creating event network-vif-deleted:0160ed4b-3862-429e-ab13-5d108761ef8f for instance d8891777-99d7-4d44-a6a7-60945ddd6ab2 on hv-cinder-78447 Jan 19 16:54:01.479315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-f8c59c30-b49e-45a0-910f-a5352eccf1c1 req-3679d7ff-aad1-4861-aea4-ff1821ae9931 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Jan 19 16:54:01.479962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1775/2468] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:54:01.706334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:01.707058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:01.713226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:01.713680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:01.714452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:01.714914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:02.010358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:02.018110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-735fb2f9-5b03-4f81-9ac2-f3d5dae20ad8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.315892 Jan 19 16:54:02.018665 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1776/2469] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:02.022992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:02.023581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] [instance: d8891777-99d7-4d44-a6a7-60945ddd6ab2] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:02.029157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:02.029615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:02.030433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:02.030877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:02.044422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] HTTP exception thrown: Instance d8891777-99d7-4d44-a6a7-60945ddd6ab2 could not be found. Jan 19 16:54:02.045007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] Returning 404 to user: Instance d8891777-99d7-4d44-a6a7-60945ddd6ab2 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:54:02.045812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b5b97da1-aa21-47e6-8bfd-3efddb7b540e tempest-AttachVolumeNegativeTest-2042282470 tempest-AttachVolumeNegativeTest-2042282470-project] 10.222.0.42 "GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2" status: 404 len: 111 microversion: 2.1 time: 0.026262 Jan 19 16:54:02.046327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1777/2470] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:02 2022] GET /compute/v2.1/servers/d8891777-99d7-4d44-a6a7-60945ddd6ab2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:54:03.034928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:03.035545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:03.042044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:03.042622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:03.043618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:03.044047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:03.116825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:03.124688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a28d1f10-9c2a-47d6-b081-5d7b4ffd3f35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.094185 Jan 19 16:54:03.125286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1778/2471] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:04.141154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:04.141779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:04.148084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:04.148544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:04.149320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:04.149791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:04.208580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:04.216231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cb165169-230a-49a5-bff2-b80583515fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078779 Jan 19 16:54:04.216795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1779/2472] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:05.232971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:05.233603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:05.240426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:05.240877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:05.241637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:05.242070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:05.298477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:05.306664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9470d208-9b2a-4eef-89dc-ca4a1808c2ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077309 Jan 19 16:54:05.307219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1780/2473] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:54:06.322778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:06.323442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:06.329597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:06.330046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:06.330805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:06.331760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:06.389238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:06.397280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-28e41904-8cad-4e65-90ab-eb94d31a7ed8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078116 Jan 19 16:54:06.397838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1781/2474] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:07.414106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:07.415654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:07.422144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:07.422598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:07.423380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:07.423838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:07.481942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:07.490115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1023868d-f109-46fc-9fa4-63551ffff3e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079743 Jan 19 16:54:07.490676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1782/2475] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:08.505951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:08.506629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:08.512774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:08.513216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:08.513983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:08.514410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:08.572252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:08.579777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a46df569-6d22-4ae0-987d-7c5982faca44 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077455 Jan 19 16:54:08.580339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1783/2476] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:09.597056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:09.597770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:09.603912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:09.604353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:09.605113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:09.605547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:09.666453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:09.674083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32dbf370-7011-4672-8347-b9b960868793 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081212 Jan 19 16:54:09.675274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1784/2477] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:10.690977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:10.691593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:10.697877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:10.698331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:10.699102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:10.699539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:10.758810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:10.769343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-81617c98-9b38-46e6-ba97-c510e5de4435 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082036 Jan 19 16:54:10.769942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1785/2478] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:11.785911 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:11.786535 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:11.793337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:11.793791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:11.794572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:11.795018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:11.854110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:11.861787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c0fdf969-9d0b-499a-b376-df19b6d1e950 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080015 Jan 19 16:54:11.862946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1786/2479] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:12.880004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:12.880649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:12.886871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:12.887318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:12.888111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:12.888547 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:12.947134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:12.954828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2fcb51cd-77b6-44e5-8da4-1ca7caab3cc8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079768 Jan 19 16:54:12.955392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1787/2480] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:13.971207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:13.971914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:13.978158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:13.978610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:13.979388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:13.979865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:14.037020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:14.045112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a8d1ce44-0bf0-401d-99cc-be3eb03529bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077567 Jan 19 16:54:14.045684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1788/2481] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:15.061680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:15.062333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:15.068347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:15.068801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:15.069579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:15.070022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:15.127090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:15.134891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9e22db51-4668-4ea7-b02a-1fd4a65c4a96 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077036 Jan 19 16:54:15.135451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1789/2482] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:16.150914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:16.151584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:16.157995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:16.158449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:16.159772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:16.160249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:16.220784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:16.228932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7c9ada8b-284c-4086-9450-6c1fce5be59c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081621 Jan 19 16:54:16.229502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1790/2483] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:17.246588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:17.247237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:17.253614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:17.254060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:17.254829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:17.255270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:17.313541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:17.321392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ece7f2e7-aab7-480c-9f33-a12f555bcd5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078373 Jan 19 16:54:17.321966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1791/2484] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:54:18.353248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:18.353961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:18.360163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:18.360621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:18.361398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:18.362354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:18.420365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:18.428747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ffd3b20-06f0-46f7-869d-3b5a3a3acb3b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079104 Jan 19 16:54:18.429315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1792/2485] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:19.445827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:19.446480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:19.452644 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:19.453094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:19.453857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:19.454293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:19.513211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:19.521563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-26d2fc9c-dc73-4805-a4e5-c663c52b4a4d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079668 Jan 19 16:54:19.522128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1793/2486] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:20.538614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:20.539281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:20.545675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:20.546120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:20.546885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:20.547316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:20.604642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:20.612326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c8e92c31-f73e-4996-a924-6cc28d3c1689 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077414 Jan 19 16:54:20.612883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1794/2487] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:21.629235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:21.629941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:21.636451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:21.636901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:21.637675 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:21.638110 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:21.697995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:21.706689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b0e03b82-9d2d-4ff2-8599-36b97246f003 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081700 Jan 19 16:54:21.707256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1795/2488] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:22.723567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:22.724206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:22.730755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:22.731233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:22.732305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:22.732739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:22.793370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:22.801023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-47d5745c-7a04-4135-8fbd-7ba838800d28 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081765 Jan 19 16:54:22.801581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1796/2489] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:23.817310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:23.817925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:23.824331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:23.824786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:23.825583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:23.826013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:23.884126 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:23.891748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be680e02-98de-4cba-85ca-b9c6eb455839 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078069 Jan 19 16:54:23.892305 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1797/2490] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:24.908464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:24.909137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:24.916199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:24.916652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:24.917426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:24.917867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:24.975483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:24.983235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-94fd325f-9e4c-4a9d-ab29-67567b13fa3e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078550 Jan 19 16:54:24.983820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1798/2491] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:25.999549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:26.000274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:26.006968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:26.007461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:26.008275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:26.008720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:26.070417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:26.078109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d15b2838-d383-4e33-8412-5757e6bc7d8d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082287 Jan 19 16:54:26.078671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1799/2492] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:27.094561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:27.095205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:27.101531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:27.101988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:27.102761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:27.103203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:27.160748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:27.168559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c5b4227c-a08b-4cba-a566-f06f26a4a630 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077684 Jan 19 16:54:27.169127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1800/2493] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:28.185449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:28.186061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:28.192318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:28.192768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:28.193539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:28.193974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:28.252127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:28.259728 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d5ff564d-ff20-4555-a8e5-ab0b6039567e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077910 Jan 19 16:54:28.260290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1801/2494] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:28.420039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:54:28.420224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:54:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:54:29.276061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:29.276683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:29.282946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:29.283403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:29.284212 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:29.284654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:29.345477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:29.353200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d4c5449b-3c61-49a3-b125-10bdf2649d85 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080739 Jan 19 16:54:29.353797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1802/2495] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:30.369464 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:30.370173 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:30.376611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:30.377106 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:30.377853 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:30.378287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:30.436023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:30.444166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9ede1db8-5fb2-45d7-9aab-04c7957ec7c2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078341 Jan 19 16:54:30.444938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1803/2496] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:31.460295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:31.460910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:31.467318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:31.467839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:31.468626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:31.469069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:31.527775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:31.536051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0e04d5c7-0ba5-46eb-80ec-ab70c8bdbc1d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079367 Jan 19 16:54:31.536619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1804/2497] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:32.553226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:32.553899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:32.560031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:32.560496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:32.561243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:32.561673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:32.619156 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:32.626924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1df663e2-0c8d-4fb2-80f6-eba51ac6835c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077849 Jan 19 16:54:32.628200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1805/2498] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:33.644741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:33.645402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:33.651778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:33.652237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:33.653015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:33.653455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:33.713168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:33.720695 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-901730cb-3baf-4b3c-80ff-b294cd1bb40b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080248 Jan 19 16:54:33.721257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1806/2499] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:34.737093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:34.737773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:34.743917 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:34.744373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:34.745143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:34.745584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:34.803468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:34.811141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fd51291e-c41b-46f9-80ca-c1a185cefe10 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077754 Jan 19 16:54:34.811737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1807/2500] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:35.827856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:35.828528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:35.834633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:35.835082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:35.835869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:35.836301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:35.897598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:35.905263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-efdaed7d-3265-4761-99df-f6f2380fa453 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081008 Jan 19 16:54:35.905824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1808/2501] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:36.922293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:36.922946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:36.929658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:36.930113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:36.930889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:36.931331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:36.989503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:36.997640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a119aab5-c1ee-4e6c-bacf-5d7d31af21cc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079009 Jan 19 16:54:36.998213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1809/2502] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:38.014638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:38.015285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:38.022193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:38.022648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:38.023423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:38.023906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:38.081211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:38.089060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a121b958-7314-466c-8b5c-fb3d70f024b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078044 Jan 19 16:54:38.089619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1810/2503] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:39.105257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:39.105949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:39.112168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:39.112619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:39.113390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:39.113829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:39.172569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:39.180294 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f5e4fbac-f1d2-42f6-b208-fbffe9f5e375 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078700 Jan 19 16:54:39.180854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1811/2504] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:40.196922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:40.198004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:40.203996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:40.204453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:40.205249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:40.205691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:40.265575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:40.273189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0743330b-29b2-4f8e-98e9-1e6c134a008e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080319 Jan 19 16:54:40.273753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1812/2505] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:41.289827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:41.290467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:41.296686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:41.297144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:41.297924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:41.298364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:41.355219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:41.363371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5cbec97b-2d56-463e-9a59-77ef722078b8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077546 Jan 19 16:54:41.363962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1813/2506] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:41.409551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:54:41.409756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:54:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:54:42.379295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:42.380048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:42.386891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:42.387340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:42.388143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:42.388660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:42.454333 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:42.462287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ebb6da1-d64f-4789-bcf4-2b3d2625aa37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.086625 Jan 19 16:54:42.462852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1814/2507] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:43.480332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:43.480992 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:43.487891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:43.488326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:43.489088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:43.489526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:43.547192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:43.555808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9f4d16e-5394-49ab-936f-9f5da4676877 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079079 Jan 19 16:54:43.556372 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1815/2508] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:44.572264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:44.572961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:44.578785 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:44.579242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:44.580090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:44.580538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:44.638321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:44.646018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2cb89a2e-fdec-4060-9180-36b6c4f5dc12 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077590 Jan 19 16:54:44.646583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1816/2509] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:45.662009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:45.662677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:45.669258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:45.669710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:45.670478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:45.670916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:45.730742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:45.738331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ee8cd3e8-520d-451c-b796-2a23a001683e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079971 Jan 19 16:54:45.738891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1817/2510] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:46.754012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:46.754683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:46.760807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:46.761259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:46.762017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:46.762450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:46.820916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:46.828564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5dcefb98-d44b-4493-9278-faa38c62ff27 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078181 Jan 19 16:54:46.829131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1818/2511] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:47.845200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:47.845863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:47.853133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:47.853589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:47.854366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:47.854807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:47.914047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:47.921986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09de42fa-d985-4b27-a172-7f934252189f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080467 Jan 19 16:54:47.922550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1819/2512] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:48.938476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:48.939129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:48.946040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:48.946489 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:48.947256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:48.947725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:49.008563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:49.016139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-549fcb10-830e-468f-b28c-bb961a9eb619 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081356 Jan 19 16:54:49.016698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1820/2513] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:50.032368 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:50.033551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:50.039983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:50.040429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:50.041187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:50.041616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:50.099436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:50.106996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7031e42-80c4-47b6-b800-ff78a4eda7dc tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078267 Jan 19 16:54:50.107558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1821/2514] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:51.124228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:51.124939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:51.131781 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:51.132233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:51.132998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:51.133430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:51.190944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:51.198482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6f846f21-4bd5-4c76-a90d-972923190ba2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077887 Jan 19 16:54:51.199044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1822/2515] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:52.213982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:52.214635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:52.220777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:52.221229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:52.221997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:52.222432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:52.280320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:52.287895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-286c7b31-fd62-4558-93f3-5c66f1fa716a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077475 Jan 19 16:54:52.288458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1823/2516] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:53.304874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:53.305494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:53.311834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:53.312297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:53.313074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:53.313514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:53.370920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:53.379277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20893e51-dd1d-4bcb-a531-07b5a77044bd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078033 Jan 19 16:54:53.379905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1824/2517] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:54.397116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:54.397972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:54.404330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:54.404775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:54.405570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:54.406002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:54.464790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:54.472519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8667a530-358f-4f19-a5ff-50f226240518 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080801 Jan 19 16:54:54.473067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1825/2518] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:54:55.489487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:55.490149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:55.496425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:55.496881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:55.497659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:55.498100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:55.561264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:55.569085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-30bf6cf7-c9b0-480f-ab57-7a6c3e973d1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083849 Jan 19 16:54:55.569648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1826/2519] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:56.585382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:56.586047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:56.592277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:56.592730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:56.593501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:56.593939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:56.651905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:56.660023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e5609c94-df55-4d17-912a-97560106e57b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078284 Jan 19 16:54:56.660623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1827/2520] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:57.676769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:57.677509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:57.684033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:57.684537 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:57.685264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:57.685705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:57.743591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:57.751145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-65976d6b-1b19-4c5c-937c-620b17e3e241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078042 Jan 19 16:54:57.752250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1828/2521] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:58.770148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:58.770750 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:58.777016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:58.777461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:58.778216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:58.778645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:58.836124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:58.843583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f9d6a0b-5580-4a38-b490-300e5e8ca624 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077596 Jan 19 16:54:58.844172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1829/2522] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:54:59.860649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:54:59.861426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:54:59.868101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:59.868554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:59.869320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:54:59.869757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:54:59.927399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:54:59.935094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1057a271-c519-438f-8c0b-30ab837e2c7f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078049 Jan 19 16:54:59.935601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1830/2523] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:54:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:00.951275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:00.951915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:00.958448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:00.958900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:00.959667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:00.960131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:01.017303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:01.025012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b42bf530-485f-4c44-b65a-be092b2e3cd1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077355 Jan 19 16:55:01.025579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1831/2524] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:02.041646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:02.042278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:02.048427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:02.048873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:02.049632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:02.050065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:02.112334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:02.119918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e5c2f652-73c3-4c52-a8ee-3f1e6908ea9f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082159 Jan 19 16:55:02.120474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1832/2525] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:03.135957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:03.136663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:03.143491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:03.143977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:03.144760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:03.145222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:03.206241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:03.213840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-82880ca1-15f4-482c-870f-b8f295129c0b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081531 Jan 19 16:55:03.214407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1833/2526] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:04.230576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:04.231238 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:04.238071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:04.238544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:04.239307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:04.239777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:04.296840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:04.304939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a20664f2-8c12-4a9a-bc5b-e1de42451f7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077978 Jan 19 16:55:04.305496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1834/2527] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:05.321315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:05.321955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:05.328301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:05.328754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:05.329529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:05.329970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:05.387775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:05.395410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f7518beb-f195-431a-aae0-43ecbf2dacba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077749 Jan 19 16:55:05.396005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1835/2528] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:06.411964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:06.412624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:06.419171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:06.419629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:06.420434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:06.420878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:06.482691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:06.490492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1cfdb305-d4d5-47da-9e4f-e117188d2335 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082748 Jan 19 16:55:06.491059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1836/2529] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:07.506565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:07.507232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:07.513568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:07.514024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:07.514802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:07.515241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:07.573424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:07.581163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3cf70ced-d0d7-4c91-b4ad-92aada631fa1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078305 Jan 19 16:55:07.581733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1837/2530] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:08.598812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:08.599572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:08.605920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:08.606367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:08.607137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:08.607570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:08.669615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:08.677205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-197fc754-aa9e-4a40-9883-e4fd8dc96bde tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083423 Jan 19 16:55:08.677764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1838/2531] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:09.694034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:09.694620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:09.700852 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:09.701293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:09.702055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:09.702481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:09.761198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:09.769362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-481074e1-f9d0-42be-92a6-9f3ef67aba34 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078925 Jan 19 16:55:09.769913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1839/2532] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:10.786339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:10.786950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:10.793529 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:10.793976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:10.794777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:10.795195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:10.857397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:10.865088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-989a59a5-2ac7-4857-9284-ee4af014c4ca tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082957 Jan 19 16:55:10.865659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1840/2533] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:11.881607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:11.882258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:11.888525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:11.888976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:11.889745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:11.890188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:11.948004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:11.955477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f19d2281-e065-4d46-b2ed-5f25322253aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077640 Jan 19 16:55:11.956058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1841/2534] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:12.972405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:12.973091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:12.979388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:12.979883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:12.980666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:12.981108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:13.038561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:13.046432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-441aeaf4-d48f-46b8-b3c5-19c3048ffa2c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077727 Jan 19 16:55:13.046995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1842/2535] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:14.063196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:14.063898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:14.070068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:14.070515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:14.071288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:14.071751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:14.128914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:14.136513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1c381b95-74cb-4877-b224-b30043ff0d8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.076962 Jan 19 16:55:14.137067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1843/2536] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:15.152830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:15.153441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:15.159321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:15.159813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:15.160587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:15.161021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:15.221652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:15.229344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6a230bd5-64e3-4eb3-a377-befe95111158 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080295 Jan 19 16:55:15.229899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1844/2537] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:16.246066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:16.246743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:16.253552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:16.254009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:16.254784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:16.255255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:16.312690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:16.320845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0afa981c-b60b-4d36-a9e9-9224def2885f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078461 Jan 19 16:55:16.321415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1845/2538] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:17.337617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:17.338246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:17.345367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:17.345939 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:17.346740 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:17.347183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:17.406678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:17.415322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-47afb261-ec22-4359-8ce2-d3fdfda748d3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081311 Jan 19 16:55:17.415913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1846/2539] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:18.431812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:18.432502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:18.438668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:18.439120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:18.439930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:18.440374 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:18.498598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:18.506445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5570f74e-e534-4e59-9180-9d7eb8e80433 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078387 Jan 19 16:55:18.507021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1847/2540] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:19.523253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:19.523929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:19.530201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:19.530647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:19.531410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:19.531875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:19.589979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:19.597578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-df8ac13d-3b48-450c-8aa5-7de6d8a7e993 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077955 Jan 19 16:55:19.598143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1848/2541] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:20.614030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:20.614720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:20.620989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:20.621432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:20.622192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:20.622620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:20.680716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:20.689163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d5655036-cced-40a3-8433-df2cf0b7067f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078290 Jan 19 16:55:20.689723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1849/2542] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:21.705623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:21.706240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:21.712501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:21.712952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:21.713722 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:21.714157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:21.775000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:21.783345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a975f3f7-f383-41ec-8ae2-c2fcdeb54dbb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080763 Jan 19 16:55:21.783944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1850/2543] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:22.800089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:22.800697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:22.806943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:22.807393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:22.808197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:22.808636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:22.866825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:22.874461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aa13756e-6ee8-48e2-9160-942d4e398262 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078531 Jan 19 16:55:22.875019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1851/2544] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:23.890859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:23.891548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:23.897703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:23.898150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:23.898916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:23.899346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:23.958554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:23.966144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a2613089-c05a-4639-8bb1-ea894b28534b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079014 Jan 19 16:55:23.966703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1852/2545] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:24.982821 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:24.983476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:24.990367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:24.990818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:24.991595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:24.992065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:25.049989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:25.057553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c86461db-c2be-4634-ab7e-0bda0c16622a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078364 Jan 19 16:55:25.058118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1853/2546] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:26.074115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:26.074799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:26.080910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:26.081365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:26.082142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:26.082589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:26.143641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:26.151469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-169efadd-90dd-4ca1-b39a-84a71549e350 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081079 Jan 19 16:55:26.152070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1854/2547] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:27.168701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:27.169321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:27.176157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:27.176616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:27.177397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:27.177839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:27.234676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:27.242936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-70b5b7a2-ba27-4431-af21-15d7dd00b0b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077968 Jan 19 16:55:27.243503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1855/2548] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:28.259957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:28.260606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:28.267448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:28.267938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:28.268714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:28.269151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:28.329116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:28.337402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-abcb3b34-ec6f-4b9a-bacc-b8049de241f0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081100 Jan 19 16:55:28.337975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1856/2549] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:29.353775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:29.354389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:29.360629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:29.361158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:29.361902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:29.362350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:29.420611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:29.428393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0ac93b75-6ae8-4620-bfa0-01bb310a5b06 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078296 Jan 19 16:55:29.428956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1857/2550] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:30.444993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:30.445683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:30.452072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:30.452526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:30.453295 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:30.453729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:30.511937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:30.519783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0b94dcab-f905-4e06-88f4-a4400311ea70 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078418 Jan 19 16:55:30.520348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1858/2551] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:31.537002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:31.537703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:31.544200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:31.544664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:31.545451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:31.545892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:31.605924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:31.613680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a22583a9-a662-460b-a5bf-7dc4f5f9f45b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081247 Jan 19 16:55:31.614250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1859/2552] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:32.630363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:32.631025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:32.637231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:32.637688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:32.638453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:32.638887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:32.697638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:32.705331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-154b8f9c-9cb5-495c-aa55-dcd2a5018e0c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079184 Jan 19 16:55:32.705890 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1860/2553] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:33.721671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:33.722278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:33.728523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:33.728977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:33.729747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:33.730180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:33.787645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:33.795422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-adccbdb8-753c-48f5-afb4-78070d877934 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077464 Jan 19 16:55:33.796026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1861/2554] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:34.812447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:34.813036 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:34.819208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:34.819658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:34.820448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:34.820876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:34.881185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:34.888830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-586570a1-8efb-4a8b-b957-e78be80ede82 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080121 Jan 19 16:55:34.889389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1862/2555] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:35.905955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:35.906641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:35.915272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:35.915759 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:35.916543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:35.916990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:35.976457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:35.984210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5c1b8e03-77b2-4b5e-928f-d3afc1db6920 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081990 Jan 19 16:55:35.984777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1863/2556] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:37.001197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:37.001835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:37.008940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:37.009538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:37.010600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:37.011320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:37.070245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:37.077895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ce83df6-4054-4bbb-a286-1209fad22b84 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080377 Jan 19 16:55:37.078453 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1864/2557] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:38.094011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:38.095181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:38.101329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:38.101777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:38.102541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:38.102978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:38.162124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:38.169930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e844a2ac-d522-4dad-9e3d-9d7e3dc729d6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079529 Jan 19 16:55:38.170495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1865/2558] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:39.186808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:39.187431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:39.194391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:39.194846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:39.195659 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:39.196128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:39.253465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:39.261141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-209fb3cf-2fa5-4a38-b79f-87ea38f81fd7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078006 Jan 19 16:55:39.261706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1866/2559] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:40.276913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:40.277576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:40.284387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:40.284846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:40.285623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:40.286062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:40.343355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:40.351487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3827a053-aa7b-49be-8de3-7fb1b0084661 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078222 Jan 19 16:55:40.352084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1867/2560] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:41.368429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:41.369055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:41.375237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:41.376328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:41.377096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:41.377528 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:41.440980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:41.448789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7f2f5b1-9cbd-45ad-99d4-3143196c9700 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083980 Jan 19 16:55:41.449341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1868/2561] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:42.465175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:42.465903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:42.473178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:42.473626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:42.474398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:42.474864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:42.532703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:42.540597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7ba2d2c-3498-4838-9e8d-e46c4a8fa372 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079180 Jan 19 16:55:42.541189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1869/2562] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:43.556924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:43.557583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:43.563906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:43.564358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:43.565129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:43.565590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:43.623099 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:43.630629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ec8c9c6-bc7f-4ae3-b03a-673e7e5f496e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077362 Jan 19 16:55:43.631188 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1870/2563] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:44.646373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:44.647062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:44.652932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:44.653386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:44.654159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:44.654601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:44.712115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:44.720216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-38eeb89b-5c15-44e2-81cb-735c1d0a335d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077689 Jan 19 16:55:44.720778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1871/2564] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:45.737071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:45.737671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:45.743967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:45.744415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:45.745187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:45.745627 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:45.805444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:45.813018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0197d642-5e06-426f-9341-4c45d1e12c16 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080220 Jan 19 16:55:45.813582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1872/2565] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:55:46.829743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:46.830420 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:46.836652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:46.837104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:46.837869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:46.838306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:46.895585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:46.903227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-adda535f-9c8e-4728-b7fe-7a238016c522 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077649 Jan 19 16:55:46.903813 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1873/2566] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:47.920386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:47.921054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:47.927900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:47.928354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:47.929125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:47.929559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:47.993788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:48.001767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-121136a1-4a05-4577-a720-a1bc674396fe tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.084940 Jan 19 16:55:48.002338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1874/2567] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:49.018268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:49.018915 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:49.025176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:49.025633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:49.026412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:49.026855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:49.088652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:49.096191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fa338053-ce65-4d46-8aff-202faa8cbdb1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081626 Jan 19 16:55:49.096764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1875/2568] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:50.112926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:50.113609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:50.119831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:50.120288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:50.121066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:50.121506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:50.179448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:50.187053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dcb8c945-dd89-4498-9a12-661aae17e439 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077777 Jan 19 16:55:50.187626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1876/2569] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:51.203263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:51.203899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:51.210117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:51.210559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:51.211321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:51.211789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:51.269267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:51.277012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5dabf6ed-b0ec-427e-a939-7ff3a366b4aa tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077353 Jan 19 16:55:51.277563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1877/2570] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:52.293601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:52.294281 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:52.300494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:52.300945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:52.301725 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:52.302163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:52.359452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:52.368208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-594a1b46-ebf0-4f0b-952d-0b72e79468ef tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078258 Jan 19 16:55:52.368773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1878/2571] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:53.384993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:53.385698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:53.392450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:53.392904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:53.393679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:53.394121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:53.453921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:53.461615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-183e1c36-c86d-4319-9a69-f6f6a8cc235d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080258 Jan 19 16:55:53.462180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1879/2572] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:54.477974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:54.478630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:54.484902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:54.485344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:54.486105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:54.486541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:54.548605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:54.556233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1ac0ed7e-01b5-4097-9714-3cfe037f8b7d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081837 Jan 19 16:55:54.556791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1880/2573] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:55.573070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:55.573755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:55.580544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:55.581001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:55.581779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:55.582221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:55.639016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:55.647229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0c500f4e-edf5-45ea-babb-399616f9ec56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077788 Jan 19 16:55:55.647823 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1881/2574] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:56.663597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:56.664574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:56.670770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:56.671226 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:56.672671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:56.673122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:56.730588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:56.739189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4dba8a1f-0039-43b9-921b-e4eeea8f4f65 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079200 Jan 19 16:55:56.739849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1882/2575] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:57.756299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:57.756953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:57.763069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:57.763515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:57.764376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:57.764809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:57.824801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:57.832549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f955b189-b90a-47a7-907a-1d8c77d96a2b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079906 Jan 19 16:55:57.833119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1883/2576] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:58.849988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:58.850604 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:58.856923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:58.857382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:58.858159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:58.858601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:58.916609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:55:58.924218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-998b0f71-2fba-4b9f-af71-9ee8e7556607 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077922 Jan 19 16:55:58.924784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1884/2577] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:55:59.940680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:55:59.941283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:55:59.947376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:59.947857 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:55:59.948617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:55:59.949046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:00.011826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:00.017479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f3077630-7b6e-445c-bf71-46a6b31b96cd tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080544 Jan 19 16:56:00.018038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1885/2578] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:55:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:01.033726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:01.034471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:01.041179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:01.041847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:01.042516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:01.042958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:01.108733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:01.117645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ade7941a-11fb-4095-9a6a-4ce8d6b6f0af tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.087516 Jan 19 16:56:01.118223 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1886/2579] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:02.134605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:02.135288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:02.142157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:02.142611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:02.143387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:02.143868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:02.201666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:02.210251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d6a8daf2-6bef-4b09-b3be-394e4e3a6705 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079265 Jan 19 16:56:02.210819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1887/2580] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:03.226477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:03.227086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:03.233701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:03.234154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:03.234963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:03.235399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:03.294192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:03.301836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aa4b06f0-98a6-4b66-9d08-a0b0d1b76c76 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079021 Jan 19 16:56:03.302396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1888/2581] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:04.318103 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:04.318789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:04.325101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:04.325563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:04.326342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:04.326788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:04.384154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:04.391985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-86a48f1a-ad95-43ea-91ee-9ce5862555e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077506 Jan 19 16:56:04.392612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1889/2582] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:05.408570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:05.409210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:05.415838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:05.416301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:05.417086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:05.417526 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:05.475275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:05.482980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4164bcfd-b818-4ba8-878a-0511d202248c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078041 Jan 19 16:56:05.483543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1890/2583] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:06.156640 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:56:06.157273 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:56:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:56:06.500492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:06.501149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:06.507536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:06.508037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:06.508824 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:06.509268 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:06.567069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:06.574770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-98552a28-af0f-4fcb-9177-be905ab00241 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078447 Jan 19 16:56:06.575336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1891/2584] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:07.591513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:07.592242 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:07.599120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:07.599608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:07.600408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:07.600851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:07.662763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:07.670734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ebc6c40-17ad-46ef-b4e2-a283b1edc972 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082843 Jan 19 16:56:07.671299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1892/2585] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:07 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:56:08.688503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:08.689111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:08.695337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:08.695826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:08.696598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:08.697037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:08.754427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:08.761982 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9ccceaef-f8a0-4632-8b9f-2cca9dd4b7a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077588 Jan 19 16:56:08.762541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1893/2586] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:09.779162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:09.779843 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:09.786723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:09.787176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:09.787979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:09.788422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:09.846522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:09.854144 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9fbd6928-5a39-49e2-b804-a23a424fda37 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078668 Jan 19 16:56:09.854705 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1894/2587] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:10.870498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:10.871098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:10.878063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:10.878518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:10.879302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:10.879774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:10.941384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:10.948999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f0eeb433-7194-4662-b3fb-3d5f45265e86 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082179 Jan 19 16:56:10.949560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1895/2588] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:11.965783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:11.966439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:11.972610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:11.973055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:11.973814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:11.974246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:12.031450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:12.039651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0834cb0e-573a-40f5-b721-0ac625830d35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077231 Jan 19 16:56:12.040306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1896/2589] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:56:13.056771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:13.057447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:13.063654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:13.064141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:13.064920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:13.065359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:13.122710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:13.130909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-be2cfefe-756a-45bd-83af-9d40bac63b6b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077835 Jan 19 16:56:13.131471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1897/2590] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:14.146958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:14.147633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:14.153921 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:14.154363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:14.155128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:14.155563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:14.365056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:14.372761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-32bb3b78-3c8f-456d-9851-531789b87ac2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.229387 Jan 19 16:56:14.373331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1898/2591] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:15.389229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:15.389829 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:15.396139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:15.396587 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:15.397354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:15.397791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:15.455310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:15.462901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ddeff694-fa50-443d-b9ed-51960842bb36 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077343 Jan 19 16:56:15.463458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1899/2592] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:16.479709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:16.480427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:16.487072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:16.487525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:16.488351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:16.488795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:16.546326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:16.554563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b4d14534-bfc8-4021-ba35-26382c12d261 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078506 Jan 19 16:56:16.555142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1900/2593] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:17.571620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:17.572326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:17.578571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:17.579515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:17.580308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:17.580735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:17.637953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:17.646201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9ee3506-6378-4d45-8868-d618eda1be68 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078258 Jan 19 16:56:17.646765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1901/2594] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:18.663248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:18.664192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:18.670310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:18.670756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:18.671514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:18.671970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:18.729801 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:18.738222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8ec6aeb4-a8a8-4a4b-a1af-45ff2126d864 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078649 Jan 19 16:56:18.738789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1902/2595] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:19.755249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:19.755874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:19.762113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:19.762555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:19.763318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:19.763780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:19.820973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:19.828445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-600e6f1c-6097-4a54-8dea-d924b11a40b3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077520 Jan 19 16:56:19.829040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1903/2596] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:19 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:20.844726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:20.845353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:20.851638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:20.852136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:20.852914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:20.853352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:20.914298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:20.921913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4d238c8a-365c-41d2-8fa6-7b902876b442 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080833 Jan 19 16:56:20.922476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1904/2597] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:21.938077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:21.938719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:21.944855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:21.945297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:21.946083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:21.946514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:22.005208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:22.012791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5fe4738e-026e-4ab9-a911-9a7999d50c97 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078416 Jan 19 16:56:22.013350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1905/2598] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:23.029727 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:23.030406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:23.036826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:23.037270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:23.038028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:23.038458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:23.096411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:23.104286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-937bf2ac-ee3c-47b0-b4cc-252e05dd9588 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078228 Jan 19 16:56:23.104844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1906/2599] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:24.119648 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:24.120339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:24.126607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:24.127055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:24.127870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:24.128308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:24.186259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:24.193871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-313333ef-f923-454a-8e58-4e0b93c8b5bb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077879 Jan 19 16:56:24.194429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1907/2600] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:25.210108 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:25.210715 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:25.216991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:25.217448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:25.218216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:25.218654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:25.276428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:25.284749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bf10255d-9efa-4dce-9fe4-5de847c140a3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078252 Jan 19 16:56:25.285325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1908/2601] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:26.301441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:26.302136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:26.308377 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:26.308828 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:26.309599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:26.310038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:26.367219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:26.374988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ef3cb39f-3762-440c-8a97-b65b56085823 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077667 Jan 19 16:56:26.375554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1909/2602] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:27.392262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:27.392922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:27.399122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:27.399568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:27.400364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:27.400796 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:27.462569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:27.470837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ce3a2532-a858-4ad8-8865-7c5b75b3d456 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082786 Jan 19 16:56:27.471399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1910/2603] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:28.486662 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:28.487296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:28.493667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:28.494118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:28.494887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:28.495320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:28.554430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:28.562071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9d4d6e8b-f831-4b5c-b665-7b1ee49d30b4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079563 Jan 19 16:56:28.562630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1911/2604] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:28 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:29.579363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:29.580025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:29.586319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:29.586778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:29.587553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:29.588022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:29.649147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:29.657028 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f362ee15-dee7-44de-ac67-0b7bf1cf7cac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081895 Jan 19 16:56:29.657581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1912/2605] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:29.999831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:56:30.000076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:56:30.674086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:30.674724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:30.681030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:30.681480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:30.682250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:30.682688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:30.740811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:30.748563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-13751dc0-4ccf-42ed-a4d2-e017b5d3852a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078715 Jan 19 16:56:30.749122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1913/2606] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:31.765892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:31.766494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:31.772930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:31.773355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:31.774140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:31.774579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:31.833053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:31.840638 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d95410de-806f-43e4-9983-d16c76f8b933 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078481 Jan 19 16:56:31.841204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1914/2607] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:32.092096 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:56:32.092730 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:56:32.586346 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:56:32.586568 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:56:32.857579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:32.858160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:32.864396 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:32.864847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:32.865615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:32.866084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:32.924505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:32.932221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-aba22132-0ad1-4b54-b33e-c11e0be4857f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078368 Jan 19 16:56:32.932786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1915/2608] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:33.949147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:33.949820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:33.956761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:33.957254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:33.958067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:33.958508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:34.018874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:34.026524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8024efef-9933-4748-952b-2d60f559c989 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081036 Jan 19 16:56:34.027090 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1916/2609] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:35.042820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:35.043479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:35.050394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:35.050839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:35.051610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:35.052078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:35.108814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:35.117228 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e512b049-ee29-43a3-9305-17b1b4c8479e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078303 Jan 19 16:56:35.117789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1917/2610] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:36.133493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:36.134175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:36.140409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:36.140883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:36.142172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:36.142612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:36.205569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:36.213233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-045e353a-29c4-4511-afec-d018f0fc9fe6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083373 Jan 19 16:56:36.213797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1918/2611] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:37.230272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:37.230879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:37.237130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:37.237577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:37.238344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:37.238783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:37.296551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:37.304107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5de38130-bd2f-435d-8fc8-2ea4b68c6bda tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077472 Jan 19 16:56:37.304670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1919/2612] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:38.320137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:38.320860 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:38.326741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:38.327198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:38.328001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:38.328447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:38.385359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:38.393117 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f61cb417-a47a-482e-9e8a-9c02fc6e114a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.076651 Jan 19 16:56:38.393681 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1920/2613] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:39.408757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:39.409384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:39.415906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:39.416362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:39.417142 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:39.417581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:39.476518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:39.484313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5042f76e-ccf4-4934-8b31-8ba9ed7145ce tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079184 Jan 19 16:56:39.484882 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1921/2614] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:40.500896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:40.501661 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:40.507840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:40.508298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:40.509078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:40.509517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:40.569651 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:40.577393 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-81f8a8a1-5984-4860-9087-36e68111b18e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080132 Jan 19 16:56:40.577959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1922/2615] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:40 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:41.595030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:41.595746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:41.601886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:41.602339 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:41.603105 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:41.603541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:41.661220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:41.669227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cd571c32-cea6-47b6-a182-e1cf6823e1d9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078450 Jan 19 16:56:41.669788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1923/2616] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:42.685635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:42.686269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:42.692509 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:42.692954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:42.693718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:42.694146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:42.753827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:42.761579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ca0911bb-69f6-44cb-9823-721025b51080 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079489 Jan 19 16:56:42.762102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1924/2617] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:43.778062 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:43.778694 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:43.785501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:43.785943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:43.786698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:43.787127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:43.843389 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:43.851692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1083fa20-8ba0-4626-8bf9-8e882567ccc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077268 Jan 19 16:56:43.852260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1925/2618] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:44.868421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:44.869055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:44.874974 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:44.875423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:44.876229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:44.876690 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:44.935314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:44.945344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-81348571-f434-49dc-866f-04ead0c20a52 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080492 Jan 19 16:56:44.946083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1926/2619] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:45.963091 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:45.963793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:45.970628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:45.971112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:45.972081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:45.972698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:46.030061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:46.038323 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0f290863-083e-48f4-8b8b-f28503a74b19 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078930 Jan 19 16:56:46.039140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1927/2620] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:47.054107 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:47.054795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:47.060968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:47.061421 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:47.062225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:47.062669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:47.123325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:47.131836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f752da48-04d2-4f15-9579-c65813013421 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081430 Jan 19 16:56:47.132409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1928/2621] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:48.148480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:48.149168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:48.155282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:48.155760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:48.156532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:48.156969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:48.214614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:48.222944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9f21d6ff-b979-4682-8d00-036dadbacbbf tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078129 Jan 19 16:56:48.223531 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1929/2622] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:56:49.239189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:49.239830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:49.246169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:49.246630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:49.247407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:49.247887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:49.305670 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:49.313288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8f271b77-79bf-4e91-9098-0219d15b9112 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077809 Jan 19 16:56:49.314382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1930/2623] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:50.330472 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:50.331160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:50.337320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:50.337772 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:50.338541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:50.338978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:50.397771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:50.405410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-98269144-2df7-44a7-aa85-8e8c7221f772 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079075 Jan 19 16:56:50.405968 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1931/2624] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:51.422491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:51.423775 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:51.430311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:51.430769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:51.431549 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:51.432025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:51.644046 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:51.652029 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b99c225e-3601-4ade-be16-9ff20f42b837 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.233099 Jan 19 16:56:51.652600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1932/2625] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:52.669354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:52.670004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:52.676721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:52.677178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:52.677966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:52.678414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:52.753458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:52.761158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7d3b8fe1-d694-47a5-9dc4-17402401df26 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.095413 Jan 19 16:56:52.761712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1933/2626] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:52 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:53.777267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:53.777967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:53.784215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:53.784703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:53.785479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:53.785923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:53.843769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:53.851326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d418b82b-2dc3-4eb5-bcd9-b778e154455f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077701 Jan 19 16:56:53.851913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1934/2627] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:54.868043 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:54.868679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:54.874895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:54.875351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:54.876154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:54.876599 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:54.939021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:54.946793 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4e1788f2-bf54-4226-ac3f-bfb22ca6adb6 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082443 Jan 19 16:56:54.947349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1935/2628] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:55.963632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:55.964304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:55.971192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:55.971788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:55.972949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:55.973700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:56.031324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:56.039730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f1ddea86-7307-484c-9d26-d7a539f580d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079730 Jan 19 16:56:56.040293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1936/2629] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:57.055485 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:57.056204 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:57.062321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:57.062782 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:57.063567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:57.064037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:57.123550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:57.131617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6e5beb1a-80a5-463c-be51-36ac8bdd5b1c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079744 Jan 19 16:56:57.132202 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1937/2630] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:58.147298 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:58.147976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:58.154149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:58.154598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:58.155367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:58.155831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:58.214789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:58.223152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ff930e20-1963-4f8a-9eef-b48c8bf4fb9b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079530 Jan 19 16:56:58.223747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1938/2631] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:56:59.239376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:56:59.240005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:56:59.246609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:59.247052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:59.247858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:56:59.248293 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:56:59.308454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:56:59.316102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a4d4a6b2-4f6d-4f2d-b15d-9a9ad6e79126 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080296 Jan 19 16:56:59.316666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1939/2632] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:56:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:00.429270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:00.429878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:00.435733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:00.436186 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:00.436949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:00.437387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:00.494711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:00.505225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7672960e-603a-493d-943a-98301d36e18b tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.176234 Jan 19 16:57:00.505804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1940/2633] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:01.522122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:01.523571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:01.530128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:01.530576 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:01.531340 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:01.531797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:01.592159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:01.600335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f1ef1ab0-1a78-40a6-a60d-763ac81b337e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082077 Jan 19 16:57:01.600910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1941/2634] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:02.616562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:02.617258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:02.623709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:02.624183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:02.624971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:02.625412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:02.683655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:02.691688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d959e153-d822-4f60-b740-3411e435f63f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078752 Jan 19 16:57:02.692245 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1942/2635] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:03.708115 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:03.708741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:03.714897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:03.715349 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:03.716148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:03.716588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:03.773869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:03.781422 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4a3b8f7-f04a-4987-ad1d-2689ce597ff3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.076935 Jan 19 16:57:03.781987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1943/2636] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:03 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:04.798276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:04.798891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:04.805177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:04.805635 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:04.806410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:04.806854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:04.865582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:04.873176 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9ffcc93b-c991-448a-8521-cf2dba75a083 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078542 Jan 19 16:57:04.873736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1944/2637] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:04 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:05.889642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:05.890246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:05.896787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:05.897276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:05.898051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:05.898493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:05.959378 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:05.967183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-995a4069-9d33-4d58-81e8-b4a6c0ff5cd5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081167 Jan 19 16:57:05.967948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1945/2638] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:05 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:06.983734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:06.984407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:06.991424 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:06.991916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:06.992698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:06.993143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:07.052530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:07.060158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-308896a3-bb9d-4221-bb8f-968f6aa212e8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080126 Jan 19 16:57:07.060718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1946/2639] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:06 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:08.076851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:08.077532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:08.084356 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:08.084811 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:08.085592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:08.086035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:08.142907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:08.151140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d914edc5-46eb-468a-b736-797ae13a24a7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077967 Jan 19 16:57:08.151706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1947/2640] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:08 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:09.167568 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:09.168263 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:09.174355 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:09.174800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:09.175560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:09.176018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:09.232990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:09.240830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-65905b4e-6f7c-4504-926e-2abfad9beda8 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077097 Jan 19 16:57:09.241399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1948/2641] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:09 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:10.257128 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:10.257803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:10.264016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:10.264473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:10.265251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:10.265689 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:10.326431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:10.334158 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-85fdd50d-1cd6-4989-9eed-29a4dd8261eb tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080640 Jan 19 16:57:10.334716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1949/2642] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:10 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:11.349985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:11.350596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:11.356855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:11.357306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:11.358082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:11.358518 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:11.416014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:11.423660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1eadfd96-2149-4d51-b5ba-99d9589dba17 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077373 Jan 19 16:57:11.424247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1950/2643] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:11 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:12.440491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:12.441184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:12.447335 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:12.447817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:12.448580 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:12.449013 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:12.510187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:12.517941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-14cc516b-3e0f-4a30-8535-4a1e907666e0 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081093 Jan 19 16:57:12.519012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1951/2644] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:12 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:13.534769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:13.535455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:13.541984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:13.542427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:13.543191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:13.543621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:13.600952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:13.608598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f3abc6d-48b5-4c4f-967e-8edd4277fb1f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078057 Jan 19 16:57:13.609149 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1952/2645] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:13 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:14.625527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:14.626216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:14.632510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:14.632954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:14.633712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:14.634139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:14.692083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:14.699645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1a264076-e76c-4b22-98ed-f991925f7df4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077734 Jan 19 16:57:14.700217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1953/2646] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:14 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:15.716134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:15.716765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:15.723628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:15.724119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:15.724898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:15.725342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:15.782319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:15.790762 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-720503a4-5ecc-46f5-bda5-4169969b60f2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078308 Jan 19 16:57:15.791321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1954/2647] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:15 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:16.807791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:16.808454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:16.814602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:16.815701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:16.816482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:16.816920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:16.874619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:16.882513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-77a0006e-327b-4e86-ad6b-f84a75874427 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078414 Jan 19 16:57:16.883083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1955/2648] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:16 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:57:17.898642 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:17.899270 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:17.905525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:17.905986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:17.906797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:17.907251 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:17.965403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:17.973087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-abe46e5d-26c1-483d-8a74-3063b8ba9f8e tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078123 Jan 19 16:57:17.973684 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1956/2649] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:17 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:18.989474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:18.990229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:18.996353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:18.996798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:18.997563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:18.997994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:19.058363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:19.066563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-887f2f20-b935-4224-affb-fbc3fc860f5d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080795 Jan 19 16:57:19.067119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1957/2650] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:18 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:20.082936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:20.083594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:20.089962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:20.090414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:20.091179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:20.091614 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:20.386913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:20.395413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-abb66060-ac2b-45e0-92ad-9a0fdc6ced90 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.316690 Jan 19 16:57:20.396018 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1958/2651] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:20 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:21.412040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:21.412660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:21.419093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:21.419546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:21.420350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:21.420790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:21.478382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:21.486019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-af822ca7-ec1e-40cf-83e6-5851879dcd20 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077689 Jan 19 16:57:21.486577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1959/2652] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:21 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:22.502035 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:22.503280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:22.509600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:22.510060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:22.510840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:22.511279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:22.570346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:22.577996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9414bad1-ed03-4947-8430-72d419104936 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079610 Jan 19 16:57:22.578544 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1960/2653] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:22 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:23.594683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:23.595328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:23.602098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:23.602550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:23.603322 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:23.603786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:23.661130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:23.669037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1e8b4f72-bf9e-4ac3-9c95-52774b1cf0db tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078168 Jan 19 16:57:23.669593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1961/2654] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:23 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:24.685358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:24.686001 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:24.692329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:24.692786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:24.693562 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:24.694004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:24.753802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:24.761595 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9de26731-99ee-41bf-af8c-35d3edeb37f4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079839 Jan 19 16:57:24.762168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1962/2655] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:24 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:25.777276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:25.777945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:25.784686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:25.785137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:25.785907 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:25.786341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:25.843839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:25.852066 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b634e3c6-d80b-46b4-a75b-05e722895074 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078433 Jan 19 16:57:25.852625 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1963/2656] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:25 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:26.868744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:26.869415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:26.875596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:26.876072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:26.876849 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:26.877883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:26.937061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:26.944733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-51dec804-05d3-4ff9-91f8-fd4346931f09 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079717 Jan 19 16:57:26.945296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1964/2657] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:26 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:27.961523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:27.962148 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:27.968365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:27.968812 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:27.969581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:27.970015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:28.027077 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:28.034745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6e172848-0aac-4cc2-9515-24cb90ca8c35 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.076879 Jan 19 16:57:28.035290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1965/2658] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:27 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:29.052431 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:29.053100 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:29.059360 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:29.059855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:29.060634 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:29.061074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:29.118581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:29.126285 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ce444450-248b-47ff-9774-4aec4cb9ac63 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077585 Jan 19 16:57:29.126848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1966/2659] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:29 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:57:30.142116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:30.143343 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:30.149743 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:30.150199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:30.150977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:30.151411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:30.208815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:30.216376 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-524e12ef-ffa8-48fa-bc25-a8e61d127414 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077935 Jan 19 16:57:30.216940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1967/2660] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:30 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:31.232733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:31.233354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:31.240196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:31.240653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:31.241429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:31.241873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:31.302205 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:31.309865 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a12c6519-79f6-448a-beb0-385c5267ed56 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080826 Jan 19 16:57:31.310426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1968/2661] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:31 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:32.326962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:32.327655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:32.334479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:32.334932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:32.335818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:32.336280 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:32.397993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:32.405623 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6d5a6147-60c0-424b-acf1-f4f12642438c tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.082341 Jan 19 16:57:32.406182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1969/2662] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:32 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:33.422153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:33.422827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:33.429065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:33.429524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:33.430302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:33.430744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:33.487983 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:33.495657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4bac4935-55dc-4793-bf62-5dd594072eb2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077189 Jan 19 16:57:33.496240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1970/2663] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:33 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:34.511753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:34.512445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:34.518603 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:34.519050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:34.519859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:34.520297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:34.580026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:34.587807 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7ba82c1b-60d5-4464-a420-89e843a8b9ad tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079728 Jan 19 16:57:34.588373 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1971/2664] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:34 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:35.605006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:35.605649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:35.612284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:35.612730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:35.613513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:35.613948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:35.671137 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:35.679320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dc60b602-377d-49a8-9a9c-a7183536a2e2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078032 Jan 19 16:57:35.679901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1972/2665] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:35 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:36.695136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:36.695776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:36.702049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:36.702498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:36.703272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:36.703741 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:36.762315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:36.769991 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-54a6ff60-8756-4b2a-ad05-73fdc3f457ac tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078526 Jan 19 16:57:36.770556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1973/2666] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:36 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:37.787120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:37.787744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:37.794171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:37.794619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:37.795379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:37.795840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:37.856214 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:37.863825 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-419e5ebb-8198-40fc-b082-d61b5c5df667 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080786 Jan 19 16:57:37.864384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1974/2667] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:37 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:38.879737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:38.880412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:38.886640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:38.887102 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:38.887905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:38.888347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:38.946764 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:38.954436 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5aaec57d-aebb-4533-b952-bb95574c6fc5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078420 Jan 19 16:57:38.955591 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1975/2668] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:38 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:39.971584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:39.972250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:39.978615 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:39.979068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:39.979883 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:39.980328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:40.039778 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:40.047440 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-839b9093-3c4b-4c68-8647-3dcb69f95b14 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080036 Jan 19 16:57:40.048039 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1976/2669] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:39 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:41.064767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:41.065494 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:41.071713 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:41.072179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:41.072962 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:41.073405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:41.134814 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:41.142458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8beac6a7-dd61-478c-8deb-3ba1d08c5ee4 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081449 Jan 19 16:57:41.143021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1977/2670] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:41 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:42.159720 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:42.160438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:42.166941 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:42.167388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:42.168185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:42.168620 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:42.225231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:42.232864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a7c08477-eb4d-4fcd-85f4-88c53b287e6a tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077323 Jan 19 16:57:42.233429 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1978/2671] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:42 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:43.249655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:43.250266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:43.256628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:43.257082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:43.257858 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:43.258296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:43.316138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:43.323738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09b65644-74e1-4eb2-bf31-a2065389474d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077775 Jan 19 16:57:43.324304 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1979/2672] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:43 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:44.340655 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:44.341369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:44.347194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:44.347649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:44.348445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:44.348885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:44.408959 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:44.416899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5516bdbb-b704-41de-8066-6b502d2c99e1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079867 Jan 19 16:57:44.417457 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1980/2673] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:44 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:45.433403 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:45.434078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:45.440452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:45.440897 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:45.441663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:45.442093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:45.502514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:45.510439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b9371455-8927-4d2d-8e92-2b67998de7f9 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.081099 Jan 19 16:57:45.511010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1981/2674] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:45 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:46.527827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:46.528523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:46.535253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:46.535716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:46.536483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:46.536913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:46.594063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:46.602362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7453c5fd-f337-4dc3-b4d5-3c7ecff601d7 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078135 Jan 19 16:57:46.602972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1982/2675] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:46 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:47.618768 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:47.619433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:47.625564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:47.626009 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:47.627276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:47.627726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:47.693611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:47.701502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7946b862-c6d9-4d6b-a4af-44071bedbf92 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.086436 Jan 19 16:57:47.702063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1983/2676] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:47 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:48.428698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:57:48.428990 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:57:48.719379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:48.720003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:48.726329 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:48.726783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:48.727560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:48.728034 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:48.787161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:48.794935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1bc8695f-a294-421d-8736-d5789f9b4dc3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079190 Jan 19 16:57:48.795493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1984/2677] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:48 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:49.811902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:49.812517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:49.819425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:49.819924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:49.820704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:49.821146 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:49.878254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:49.885878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-de4d0548-0cc7-45dc-bc24-a9eeaaefeee3 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077613 Jan 19 16:57:49.886455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1985/2678] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:49 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:50.902182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:50.902786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:50.908985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:50.909437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:50.910211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:50.910645 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:50.971282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:50.979070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a5c12087-a4b9-49ff-a260-d9d3e86d1b30 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.080622 Jan 19 16:57:50.979632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1986/2679] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:50 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:51.996198 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:51.996957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:52.003321 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:52.003808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:52.004586 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:52.005017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:52.063641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:52.071667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-363db7f8-0aaa-406a-9fb5-b7f14f656cba tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079037 Jan 19 16:57:52.072237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1987/2680] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:51 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:53.088699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:53.089308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:53.095582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:53.096071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:53.096851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:53.097290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:53.155088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:53.162835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8fb68eb7-ccf7-440b-9a7b-c0006fc1879f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077867 Jan 19 16:57:53.163652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1988/2681] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:53 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:54.179071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:54.179779 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:54.186210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:54.186686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:54.187451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:54.187928 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:54.245353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:54.253299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f4285b50-ce05-4c56-a644-ac434cdfe24f tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.077842 Jan 19 16:57:54.253859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1989/2682] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:54 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:55.269840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:55.270447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:55.276704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:55.277159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:55.277931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:55.278366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:55.338088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:55.345737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ed58ce0d-0ddf-4da2-877a-a83dbb8eafe1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079576 Jan 19 16:57:55.346301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1990/2683] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:55 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:56.361868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:56.362510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:56.368719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:56.369164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:56.369925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:56.370383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:56.433866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:56.442119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9684e1e2-0b65-45ec-902f-c1262f05054d tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.083850 Jan 19 16:57:56.442678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1991/2684] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:56 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:57.458444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:57.459051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:57.465399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:57.465863 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:57.466639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:57.467082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:57.525388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:57.533381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cd7b6810-348b-4081-b3c6-cc28196ba796 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079019 Jan 19 16:57:57.533944 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1992/2685] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:57 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:58.550657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:58.551452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:58.557763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:58.558220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:58.559003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:58.559446 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:58.617266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:58.624879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-48b4a663-7f2c-4fe1-8097-fe9b524a87b2 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078522 Jan 19 16:57:58.625445 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1993/2686] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:58 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:57:59.641056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:57:59.641649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:57:59.648515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:59.648960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:59.649733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:57:59.650161 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:57:59.709780 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:57:59.717334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0a7576df-205e-44df-bc72-a1fb3dbd5100 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.079805 Jan 19 16:57:59.717896 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1994/2687] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:57:59 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:00.734022 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:00.734633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:00.741222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:00.741680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:00.742463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:00.742905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:00.801287 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:00.809068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2ac963e1-c980-426a-88c9-26542134c035 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.078597 Jan 19 16:58:00.809573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1995/2688] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:00 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:01.417988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:58:01.418224 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 16:58:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 16:58:01.825546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:01.826167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:01.837069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:01.837533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:01.838319 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:01.841183 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:01.909947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:01.919709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-82bf2bf3-04d0-4a34-b5c2-c6b23ed0fdb5 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.097820 Jan 19 16:58:01.920449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1996/2689] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:01 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:02.937000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:02.937674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] [instance: e119b741-b721-47fa-a03f-be8689acf2fd] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:02.944891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:02.945342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:02.946357 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:02.946803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:03.023988 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cf4070604248688b69a8b7c9aedbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f640855c21440159a63a89bfa2a4fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:03.035325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d53e1487-2075-4a51-9a71-a32e56d2f3d1 tempest-ServerRescueNegativeTestJSON-225612795 tempest-ServerRescueNegativeTestJSON-225612795-project] 10.222.0.42 "GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd" status: 200 len: 1353 microversion: 2.1 time: 0.100997 Jan 19 16:58:03.038002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1997/2690] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:02 2022] GET /compute/v2.1/servers/e119b741-b721-47fa-a03f-be8689acf2fd => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:04.521031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6ccb61bf-49bb-4962-b17b-71878e02ccbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa37f59c-c670-4be8-85cd-86606c82e08a"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:04.522354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6ccb61bf-49bb-4962-b17b-71878e02ccbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:04.536443 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ccb61bf-49bb-4962-b17b-71878e02ccbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:04.536913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ccb61bf-49bb-4962-b17b-71878e02ccbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:04.540710 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ccb61bf-49bb-4962-b17b-71878e02ccbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:04.542757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6ccb61bf-49bb-4962-b17b-71878e02ccbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:05.197084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6ccb61bf-49bb-4962-b17b-71878e02ccbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680570 Jan 19 16:58:05.200652 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1998/2691] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:58:04 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:05.210003 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1688472254", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452", "networks": [{"uuid": "61c752aa-bbe8-44e6-8f2f-8f5fe9557f72"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:05.332483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] validate_networks() for [('61c752aa-bbe8-44e6-8f2f-8f5fe9557f72', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 16:58:06.323063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 16:58:06.331038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 16:58:06.331904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 16:58:06.333067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 16:58:06.334558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 16:58:06.349447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:06.351629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:06.353698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:06.357574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:06.388680 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Getting quotas for project 1aa2c73bd1cb4a0bb7fbb2b583473256. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 16:58:06.393636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Getting quotas for user 842191a2a2f94550aa4427649656ed38 and project 1aa2c73bd1cb4a0bb7fbb2b583473256. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 16:58:06.408060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 16:58:06.411596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 16:58:06.467055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f67b6641-d750-4e85-b2d3-141577b87f13 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264898 Jan 19 16:58:06.467859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 1999/2692] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 16:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 19 16:58:06.472949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:06.473691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:06.481601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:06.482394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:06.483388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:06.484045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:06.511584 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 could not be found. Jan 19 16:58:06.512470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:06.529616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c3d32167-43ed-426c-b021-39e8cfb8dce1 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 404 len: 111 microversion: 2.20 time: 0.059793 Jan 19 16:58:06.530718 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2000/2693] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jan 19 16:58:06 2022] DELETE /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:58:06.537379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a3ec3e55-d66e-4ddf-bfd4-5f9d1ef394cc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:06.538211 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a3ec3e55-d66e-4ddf-bfd4-5f9d1ef394cc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:06.687308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a3ec3e55-d66e-4ddf-bfd4-5f9d1ef394cc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:06.708337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a3ec3e55-d66e-4ddf-bfd4-5f9d1ef394cc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1219 microversion: 2.1 time: 0.176102 Jan 19 16:58:06.719052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2001/2694] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:06 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:58:06.727195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:06.728352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] [instance: 2b42b29d-6ec2-4fd8-b110-48af10080a11] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:06.742367 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:06.743058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:06.744345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:06.745031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:06.761474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] HTTP exception thrown: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 could not be found. Jan 19 16:58:06.762394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] Returning 404 to user: Instance 2b42b29d-6ec2-4fd8-b110-48af10080a11 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:06.763559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dc80b208-d46d-4daa-b172-47d18a8497c3 tempest-AttachVolumeShelveTestJSON-1354564930 tempest-AttachVolumeShelveTestJSON-1354564930-project] 10.222.0.42 "GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11" status: 404 len: 111 microversion: 2.20 time: 0.043036 Jan 19 16:58:06.764324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2002/2695] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jan 19 16:58:06 2022] GET /compute/v2.1/servers/2b42b29d-6ec2-4fd8-b110-48af10080a11 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 19 16:58:07.046197 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-f46328f7-4363-47ac-9aa5-d65784cc3b67 req-11ada676-0a4d-4454-822d-e0725ba77abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda15853-ef18-40f3-9063-9e714ebd9a12", "name": "network-vif-deleted", "tag": "02b33aa9-3f6d-484d-b8ed-49177f61589f"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:07.047969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:58:07.047969 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:58:07.073958 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-f46328f7-4363-47ac-9aa5-d65784cc3b67 req-11ada676-0a4d-4454-822d-e0725ba77abf service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:07.076574 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-f46328f7-4363-47ac-9aa5-d65784cc3b67 req-11ada676-0a4d-4454-822d-e0725ba77abf service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:07.101299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-f46328f7-4363-47ac-9aa5-d65784cc3b67 req-11ada676-0a4d-4454-822d-e0725ba77abf service nova] Creating event network-vif-deleted:02b33aa9-3f6d-484d-b8ed-49177f61589f for instance eda15853-ef18-40f3-9063-9e714ebd9a12 on hv-cinder-78447 Jan 19 16:58:07.114754 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-f46328f7-4363-47ac-9aa5-d65784cc3b67 req-11ada676-0a4d-4454-822d-e0725ba77abf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.348933 Jan 19 16:58:07.115352 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2003/2696] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:07.732084 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:07.732789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:07.739296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:07.739777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:07.740560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:07.740999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:07.803358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:07.810756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b582e29b-8eb3-4d88-b96b-3ca4a43cd53a tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1271 microversion: 2.1 time: 0.082726 Jan 19 16:58:07.811332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2004/2697] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:07 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:08.827773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:08.829434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:08.841948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:08.843834 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:08.846767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:08.847430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:09.282891 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:09.295154 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cd20828c-6fb2-4091-a69a-e1d1b2936982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1319 microversion: 2.1 time: 0.470842 Jan 19 16:58:09.296271 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2005/2698] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:08 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:10.312957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:10.314256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:10.324381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:10.324840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:10.325633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:10.326072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:10.719366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:10.728167 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b92920cb-ec1d-4cf1-93d9-1f36f95bbaf0 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1319 microversion: 2.1 time: 0.418597 Jan 19 16:58:10.731964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2006/2699] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:10 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:58:10.762699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-485d2e03-fd09-4ceb-adac-f5e37c5be1eb req-a6e5f2d2-0775-4db1-a420-c469bedebd5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c191150-ff10-4686-b24f-b589e8a89878", "tag": "0ee48741-9e1f-464f-b036-53f99c8e4498"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:10.773248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:58:10.773248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:58:10.794760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-485d2e03-fd09-4ceb-adac-f5e37c5be1eb req-a6e5f2d2-0775-4db1-a420-c469bedebd5d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:10.795208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-485d2e03-fd09-4ceb-adac-f5e37c5be1eb req-a6e5f2d2-0775-4db1-a420-c469bedebd5d service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:10.811977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-485d2e03-fd09-4ceb-adac-f5e37c5be1eb req-a6e5f2d2-0775-4db1-a420-c469bedebd5d service nova] Creating event network-changed:0ee48741-9e1f-464f-b036-53f99c8e4498 for instance 7c191150-ff10-4686-b24f-b589e8a89878 on hv-cinder-78447 Jan 19 16:58:10.822889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-485d2e03-fd09-4ceb-adac-f5e37c5be1eb req-a6e5f2d2-0775-4db1-a420-c469bedebd5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067664 Jan 19 16:58:10.823701 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2007/2700] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:11.748064 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:11.750434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:11.766181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:11.767697 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:11.769787 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:11.770702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:12.169831 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:12.183020 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ec0bc7d6-b84f-4200-8b7c-ffb84c3778a9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1319 microversion: 2.1 time: 0.440223 Jan 19 16:58:12.183972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2008/2701] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:11 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:13.071487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4ea4a77e-1b71-49bc-88d0-c8b9f94b6a9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:13.073887 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4ea4a77e-1b71-49bc-88d0-c8b9f94b6a9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:13.081916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ea4a77e-1b71-49bc-88d0-c8b9f94b6a9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:13.082385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ea4a77e-1b71-49bc-88d0-c8b9f94b6a9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:13.083175 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ea4a77e-1b71-49bc-88d0-c8b9f94b6a9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:13.083621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4ea4a77e-1b71-49bc-88d0-c8b9f94b6a9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:13.126266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4ea4a77e-1b71-49bc-88d0-c8b9f94b6a9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060847 Jan 19 16:58:13.132182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2009/2702] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:58:13 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:13.139427 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f5c37317-4b56-442c-907c-e5025f7571ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:13.140344 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f5c37317-4b56-442c-907c-e5025f7571ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:13.147602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5c37317-4b56-442c-907c-e5025f7571ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:13.148191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5c37317-4b56-442c-907c-e5025f7571ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:13.149072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5c37317-4b56-442c-907c-e5025f7571ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:13.149600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f5c37317-4b56-442c-907c-e5025f7571ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:13.192808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f5c37317-4b56-442c-907c-e5025f7571ca tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/fa37f59c-c670-4be8-85cd-86606c82e08a" status: 200 len: 194 microversion: 2.1 time: 0.058914 Jan 19 16:58:13.197914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2010/2703] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jan 19 16:58:13 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/fa37f59c-c670-4be8-85cd-86606c82e08a => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:13.200647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:13.201512 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:13.209311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:13.210074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:13.211402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:13.211986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:13.460231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:13.470867 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-bfb38b55-7f8b-42bb-a229-564bfc070eda tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1319 microversion: 2.1 time: 0.275352 Jan 19 16:58:13.484259 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2011/2704] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:13 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:14.265277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e311e26d-0dd2-44b8-85f9-ef2daf0c8780 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Action: 'create', calling method: .version_select at 0x7f716fcc7790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1862097566"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:14.561688 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e311e26d-0dd2-44b8-85f9-ef2daf0c8780 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.553938 Jan 19 16:58:14.562734 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2012/2705] 10.222.0.42 () {60 vars in 1154 bytes} [Wed Jan 19 16:58:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 556 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 19 16:58:14.568286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:14.569511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:14.577351 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:14.577809 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:14.578739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:14.579451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:14.717564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:14.726342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-10a242ab-f183-4bd2-8735-7c6361cb3adc tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1319 microversion: 2.1 time: 0.162396 Jan 19 16:58:14.727819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2013/2706] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:14 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:58:14.732438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-438e8165-8ce1-4431-a527-d4fb684a89d7 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716d7f8a60>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:14.797049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-438e8165-8ce1-4431-a527-d4fb684a89d7 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9" status: 200 len: 345 microversion: 2.1 time: 0.067758 Jan 19 16:58:14.797618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2014/2707] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:14 2022] GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:14.802639 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6d954933-b090-472e-b21e-7e7b75a10986 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8d92bb7-3a44-4d0a-8502-e9e516398415"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:14.803817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6d954933-b090-472e-b21e-7e7b75a10986 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:14.809691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d954933-b090-472e-b21e-7e7b75a10986 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:14.810088 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d954933-b090-472e-b21e-7e7b75a10986 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:14.810864 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d954933-b090-472e-b21e-7e7b75a10986 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:14.811307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6d954933-b090-472e-b21e-7e7b75a10986 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:15.038667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6d954933-b090-472e-b21e-7e7b75a10986 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239562 Jan 19 16:58:15.039299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2015/2708] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:58:14 2022] POST /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:15.275381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-884fdc9a-417c-4491-9ef6-d610cb3f9d48 req-d10e3f52-3e55-454f-88e6-3aa226187fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c191150-ff10-4686-b24f-b589e8a89878", "name": "network-vif-plugged", "status": "completed", "tag": "0ee48741-9e1f-464f-b036-53f99c8e4498"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:15.277058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:58:15.277058 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:58:15.285025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-884fdc9a-417c-4491-9ef6-d610cb3f9d48 req-d10e3f52-3e55-454f-88e6-3aa226187fbf service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:15.285480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-884fdc9a-417c-4491-9ef6-d610cb3f9d48 req-d10e3f52-3e55-454f-88e6-3aa226187fbf service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:15.297612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-884fdc9a-417c-4491-9ef6-d610cb3f9d48 req-d10e3f52-3e55-454f-88e6-3aa226187fbf service nova] Creating event network-vif-plugged:0ee48741-9e1f-464f-b036-53f99c8e4498 for instance 7c191150-ff10-4686-b24f-b589e8a89878 on hv-cinder-78447 Jan 19 16:58:15.302552 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-884fdc9a-417c-4491-9ef6-d610cb3f9d48 req-d10e3f52-3e55-454f-88e6-3aa226187fbf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149398 Jan 19 16:58:15.303124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2016/2709] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:15.745601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:15.746441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:15.758902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:15.758902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:15.758902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:15.758902 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:15.907412 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:15.915502 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-447ee324-6811-4481-acf5-bb268dec98fd tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1319 microversion: 2.1 time: 0.175482 Jan 19 16:58:15.916618 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2017/2710] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:15 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:15.921365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f9686688-c05e-47ae-a87d-e0a3749d43d4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716fcbc9d0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:15.981159 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f9686688-c05e-47ae-a87d-e0a3749d43d4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9" status: 200 len: 346 microversion: 2.1 time: 0.063104 Jan 19 16:58:15.981729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2018/2711] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:15 2022] GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:15.993932 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b3b81d3e-0814-4f49-8756-1239187555ba tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Action: 'create', calling method: .version_select at 0x7f716d7f8160>, body: {"snapshot": {"volume_id": "e89e3e73-246f-4d52-bc98-97939c7c78a9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1317901553"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:16.219302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b3b81d3e-0814-4f49-8756-1239187555ba tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.229210 Jan 19 16:58:16.220473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2019/2712] 10.222.0.42 () {60 vars in 1161 bytes} [Wed Jan 19 16:58:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:16.230668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-18ee4185-c76d-4d92-8cb9-1507c00ecdf9 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c2ffa60>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:16.261310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-18ee4185-c76d-4d92-8cb9-1507c00ecdf9 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 287 microversion: 2.1 time: 0.034460 Jan 19 16:58:16.261841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2020/2713] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:16 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:16.271047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e4f2fead-1caa-4bd4-8a22-ef32d742a300 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716fcb4940>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:16.299047 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e4f2fead-1caa-4bd4-8a22-ef32d742a300 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.031448 Jan 19 16:58:16.300264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2021/2714] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Jan 19 16:58:16 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:16.309462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f973487c-be0b-4fd0-8c0f-fd870a7d4ca9 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716fcc7790>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:16.338498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f973487c-be0b-4fd0-8c0f-fd870a7d4ca9 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 287 microversion: 2.1 time: 0.032212 Jan 19 16:58:16.338995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2022/2715] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:16 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:16.932669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:16.933325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:16.939619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:16.940598 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:16.941369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:16.941806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:17.067723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:17.075243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b245efc-d036-449c-ae5c-ac8449cbb982 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1506 microversion: 2.1 time: 0.146224 Jan 19 16:58:17.075836 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2023/2716] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:16 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:17.091325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-44073f72-ef3a-471d-b88e-9244655ac87b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6d61b3e-ffc3-40b8-8416-7bc0683c8dea", "device": "/dev/sdb"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:17.092501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-44073f72-ef3a-471d-b88e-9244655ac87b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:17.098151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44073f72-ef3a-471d-b88e-9244655ac87b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:17.098641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44073f72-ef3a-471d-b88e-9244655ac87b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:17.099418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44073f72-ef3a-471d-b88e-9244655ac87b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:17.099913 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44073f72-ef3a-471d-b88e-9244655ac87b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:18.567150 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-44073f72-ef3a-471d-b88e-9244655ac87b tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "POST /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.479136 Jan 19 16:58:18.567839 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2024/2717] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 16:58:17 2022] POST /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878/os-volume_attachments => generated 194 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:18.573888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-93fa7a93-fefd-4de4-b825-76aae7e23e24 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c2ff700>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:18.603428 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-93fa7a93-fefd-4de4-b825-76aae7e23e24 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 287 microversion: 2.1 time: 0.034355 Jan 19 16:58:18.604037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2025/2718] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:18 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:19.615578 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4323b570-5a4b-48c8-9d88-d189bd1a20d4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c242700>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:19.643290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4323b570-5a4b-48c8-9d88-d189bd1a20d4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 287 microversion: 2.1 time: 0.032274 Jan 19 16:58:19.643931 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2026/2719] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:19 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:20.655131 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b7ad490f-7acc-42d4-b631-824c3440769d tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f7166f81700>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:20.684217 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b7ad490f-7acc-42d4-b631-824c3440769d tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 288 microversion: 2.1 time: 0.033076 Jan 19 16:58:20.684800 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2027/2720] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:20 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:20.694783 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-223276d1-fc63-4a91-99de-be188ff93549 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f7166fa1ca0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:20.752906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-223276d1-fc63-4a91-99de-be188ff93549 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 202 len: 0 microversion: 2.1 time: 0.060854 Jan 19 16:58:20.753481 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2028/2721] 10.222.0.42 () {58 vars in 1253 bytes} [Wed Jan 19 16:58:20 2022] DELETE /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:58:20.761362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b68413ea-bf63-4c5d-8ffc-0616ece0dc97 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c242310>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:20.789461 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b68413ea-bf63-4c5d-8ffc-0616ece0dc97 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 287 microversion: 2.1 time: 0.031429 Jan 19 16:58:20.790006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2029/2722] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:20 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:21.801172 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-51d9ef5b-faea-442f-b5c4-7768f02dab68 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c357160>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:21.828155 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-51d9ef5b-faea-442f-b5c4-7768f02dab68 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 287 microversion: 2.1 time: 0.031042 Jan 19 16:58:21.828691 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2030/2723] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:21 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:22.840288 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b5e84677-c535-4af1-bb5a-3c43ab06b6af tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c14c8b0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:22.870279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b5e84677-c535-4af1-bb5a-3c43ab06b6af tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 200 len: 287 microversion: 2.1 time: 0.033892 Jan 19 16:58:22.870963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2031/2724] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:22 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:23.882819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1b365000-4778-4247-8af1-3c3024e7f0ec tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f7166f81e50>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:23.909341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-1b365000-4778-4247-8af1-3c3024e7f0ec tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] HTTP exception thrown: Snapshot fcd630ba-d6da-4b84-ab6b-0d4f425f4486 could not be found. Jan 19 16:58:23.909948 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1b365000-4778-4247-8af1-3c3024e7f0ec tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Returning 404 to user: Snapshot fcd630ba-d6da-4b84-ab6b-0d4f425f4486 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:23.910799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1b365000-4778-4247-8af1-3c3024e7f0ec tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486" status: 404 len: 111 microversion: 2.1 time: 0.032108 Jan 19 16:58:23.911380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2032/2725] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jan 19 16:58:23 2022] GET /compute/v2.1/os-snapshots/fcd630ba-d6da-4b84-ab6b-0d4f425f4486 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:58:23.919805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-48692105-f758-4474-8d92-b456afd790f2 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f7166f895e0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:23.980434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-48692105-f758-4474-8d92-b456afd790f2 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9" status: 202 len: 0 microversion: 2.1 time: 0.063992 Jan 19 16:58:23.984379 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2033/2726] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jan 19 16:58:23 2022] DELETE /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:58:23.989409 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f7019a3-f9cc-4f87-8e9d-cc1bf8c14e41 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f7166f81e50>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:24.034408 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f7019a3-f9cc-4f87-8e9d-cc1bf8c14e41 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9" status: 200 len: 345 microversion: 2.1 time: 0.048955 Jan 19 16:58:24.034978 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2034/2727] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:23 2022] GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:24.613739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fbe100f2-9a01-484c-8a9a-5a32e58c7038 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:24.615085 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fbe100f2-9a01-484c-8a9a-5a32e58c7038 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:24.622069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbe100f2-9a01-484c-8a9a-5a32e58c7038 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:24.622742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbe100f2-9a01-484c-8a9a-5a32e58c7038 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:24.623756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbe100f2-9a01-484c-8a9a-5a32e58c7038 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:24.624451 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fbe100f2-9a01-484c-8a9a-5a32e58c7038 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:24.661769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fbe100f2-9a01-484c-8a9a-5a32e58c7038 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052281 Jan 19 16:58:24.662269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2035/2728] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:58:24 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:25.044055 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-cd56048e-b43c-4942-8a4a-00b84fabfb9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:25.044746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-cd56048e-b43c-4942-8a4a-00b84fabfb9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:25.052061 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd56048e-b43c-4942-8a4a-00b84fabfb9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:25.052454 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd56048e-b43c-4942-8a4a-00b84fabfb9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:25.053240 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd56048e-b43c-4942-8a4a-00b84fabfb9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:25.053683 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-cd56048e-b43c-4942-8a4a-00b84fabfb9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:25.084171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-cd56048e-b43c-4942-8a4a-00b84fabfb9b tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/fa37f59c-c670-4be8-85cd-86606c82e08a" status: 200 len: 194 microversion: 2.1 time: 0.045900 Jan 19 16:58:25.084763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2036/2729] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jan 19 16:58:25 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/fa37f59c-c670-4be8-85cd-86606c82e08a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:25.093386 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05d87152-ceab-4fae-8d3e-73b8fd5c0c11 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716fc40550>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:25.118940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-05d87152-ceab-4fae-8d3e-73b8fd5c0c11 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] HTTP exception thrown: Volume e89e3e73-246f-4d52-bc98-97939c7c78a9 could not be found. Jan 19 16:58:25.119575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05d87152-ceab-4fae-8d3e-73b8fd5c0c11 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Returning 404 to user: Volume e89e3e73-246f-4d52-bc98-97939c7c78a9 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:25.120465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-05d87152-ceab-4fae-8d3e-73b8fd5c0c11 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9" status: 404 len: 109 microversion: 2.1 time: 0.030428 Jan 19 16:58:25.121014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2037/2730] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:25 2022] GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:58:25.125415 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:25.125912 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:25.133950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:25.134162 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:25.134806 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:25.135369 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:25.211987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lazy-loading 'services' on Instance uuid ff6d642e-934e-484f-91bb-ea63aa4a7ad9 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:58:25.281410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f06a8b97-b992-4415-a869-517773974426 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/fa37f59c-c670-4be8-85cd-86606c82e08a" status: 202 len: 0 microversion: 2.1 time: 0.159204 Jan 19 16:58:25.282299 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2038/2731] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:58:25 2022] DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/fa37f59c-c670-4be8-85cd-86606c82e08a => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:58:25.288050 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-18476831-8a2a-419e-8267-14f39e3f0827 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c1c1160>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:25.337673 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-18476831-8a2a-419e-8267-14f39e3f0827 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] HTTP exception thrown: Volume e89e3e73-246f-4d52-bc98-97939c7c78a9 could not be found. Jan 19 16:58:25.338505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-18476831-8a2a-419e-8267-14f39e3f0827 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Returning 404 to user: Volume e89e3e73-246f-4d52-bc98-97939c7c78a9 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:25.339619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-18476831-8a2a-419e-8267-14f39e3f0827 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9" status: 404 len: 109 microversion: 2.1 time: 0.056135 Jan 19 16:58:25.340640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2039/2732] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jan 19 16:58:25 2022] DELETE /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:58:25.348350 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40bc29e3-552f-4017-9082-4348c59978b4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Calling method '.version_select at 0x7f716c357430>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:25.380391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-40bc29e3-552f-4017-9082-4348c59978b4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] HTTP exception thrown: Volume e89e3e73-246f-4d52-bc98-97939c7c78a9 could not be found. Jan 19 16:58:25.381032 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-40bc29e3-552f-4017-9082-4348c59978b4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] Returning 404 to user: Volume e89e3e73-246f-4d52-bc98-97939c7c78a9 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:25.381869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-40bc29e3-552f-4017-9082-4348c59978b4 tempest-VolumesSnapshotsTestJSON-430040622 tempest-VolumesSnapshotsTestJSON-430040622-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9" status: 404 len: 109 microversion: 2.1 time: 0.037349 Jan 19 16:58:25.382417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2040/2733] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:25 2022] GET /compute/v2.1/os-volumes/e89e3e73-246f-4d52-bc98-97939c7c78a9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:58:28.146441 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2f36cb45-0a52-4ccb-95ee-809296aaab45 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716c1c14c0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:28.204776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2f36cb45-0a52-4ccb-95ee-809296aaab45 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8c9604cc-29fd-46c5-9078-fb163af8e22f" status: 200 len: 351 microversion: 2.1 time: 0.063141 Jan 19 16:58:28.205649 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2041/2734] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:28 2022] GET /compute/v2.1/os-volumes/8c9604cc-29fd-46c5-9078-fb163af8e22f => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:29.527886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fe3be7fc-a3a1-4373-b827-2ad66e11a7b6 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f7166f81700>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:29.589976 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fe3be7fc-a3a1-4373-b827-2ad66e11a7b6 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a5bae393-851d-403d-ab28-89ce9c2e7368" status: 200 len: 351 microversion: 2.1 time: 0.066953 Jan 19 16:58:29.591745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2042/2735] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:29 2022] GET /compute/v2.1/os-volumes/a5bae393-851d-403d-ab28-89ce9c2e7368 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:31.087664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f0cba669-9d50-464b-8a96-3222dec98928 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716fcc7550>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:31.148493 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f0cba669-9d50-464b-8a96-3222dec98928 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5e294eae-4f49-42e2-a589-92c2bbb8bd52" status: 200 len: 351 microversion: 2.1 time: 0.064466 Jan 19 16:58:31.148923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2043/2736] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jan 19 16:58:31 2022] GET /compute/v2.1/os-volumes/5e294eae-4f49-42e2-a589-92c2bbb8bd52 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:31.160277 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-797250f1-b60c-48cd-8dbb-b8fe03a09c68 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716c1c18b0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:31.239855 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-797250f1-b60c-48cd-8dbb-b8fe03a09c68 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082930 Jan 19 16:58:31.240505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2044/2737] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Jan 19 16:58:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:31.253250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3081fa46-a188-4fc6-bd9d-d77ae4edac69 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716fc40280>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:31.335309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3081fa46-a188-4fc6-bd9d-d77ae4edac69 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086399 Jan 19 16:58:31.335920 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2045/2738] 10.222.0.42 () {58 vars in 1148 bytes} [Wed Jan 19 16:58:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:31.347341 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-05586fe3-d2a8-4a51-a0bb-0b9189b978ad tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716d7f8790>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:31.425447 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-05586fe3-d2a8-4a51-a0bb-0b9189b978ad tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081470 Jan 19 16:58:31.426241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2046/2739] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Jan 19 16:58:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:31.438567 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-df228b88-9ee9-4b3c-8f4b-33863ac1c08f tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716fbeaa60>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:31.662742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-df228b88-9ee9-4b3c-8f4b-33863ac1c08f tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.227558 Jan 19 16:58:31.663582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2047/2740] 10.222.0.42 () {58 vars in 1166 bytes} [Wed Jan 19 16:58:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:31.675181 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-18c08561-1e74-49f0-ba40-47a454606f14 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716fcc7ca0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:32.068937 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-18c08561-1e74-49f0-ba40-47a454606f14 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.397780 Jan 19 16:58:32.076392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2048/2741] 10.222.0.42 () {58 vars in 1169 bytes} [Wed Jan 19 16:58:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:32.082525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f98476fb-6561-4eff-ae10-59efaad46680 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716c2ff9d0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:32.208946 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f98476fb-6561-4eff-ae10-59efaad46680 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.131269 Jan 19 16:58:32.209784 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2049/2742] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Jan 19 16:58:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:58:32.219925 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e27ebbac-5f00-4443-a8a3-a0a7a585e98e tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716fbea1f0>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:32.305536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e27ebbac-5f00-4443-a8a3-a0a7a585e98e tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088836 Jan 19 16:58:32.306174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2050/2743] 10.222.0.42 () {58 vars in 1187 bytes} [Wed Jan 19 16:58:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:32.316980 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-41989685-bd08-4d78-964d-eded91cc0f94 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] Calling method '.version_select at 0x7f716d7f8160>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:32.391336 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-41989685-bd08-4d78-964d-eded91cc0f94 tempest-VolumesTestJSON-1751734647 tempest-VolumesTestJSON-1751734647-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.077560 Jan 19 16:58:32.391960 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2051/2744] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Jan 19 16:58:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:34.249407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-717279c4-e009-4c6c-b61c-b363772bc9f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:34.250019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-717279c4-e009-4c6c-b61c-b363772bc9f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:34.256654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-717279c4-e009-4c6c-b61c-b363772bc9f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:34.257231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-717279c4-e009-4c6c-b61c-b363772bc9f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:34.258025 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-717279c4-e009-4c6c-b61c-b363772bc9f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:34.258474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-717279c4-e009-4c6c-b61c-b363772bc9f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:34.287157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-717279c4-e009-4c6c-b61c-b363772bc9f3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/f8d92bb7-3a44-4d0a-8502-e9e516398415" status: 200 len: 194 microversion: 2.1 time: 0.042043 Jan 19 16:58:34.287760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2052/2745] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jan 19 16:58:34 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/f8d92bb7-3a44-4d0a-8502-e9e516398415 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:34.298072 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:34.298579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:34.305012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:34.305471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:34.306255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:34.306739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:34.387533 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lazy-loading 'services' on Instance uuid ff6d642e-934e-484f-91bb-ea63aa4a7ad9 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:58:34.464611 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2beb0b30-5bf1-4e24-a296-40dfd316d8a0 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/f8d92bb7-3a44-4d0a-8502-e9e516398415" status: 202 len: 0 microversion: 2.1 time: 0.170324 Jan 19 16:58:34.465312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2053/2746] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:58:34 2022] DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments/f8d92bb7-3a44-4d0a-8502-e9e516398415 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 16:58:39.832313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-349b01ae-2b3a-464b-9ade-ebaa962296b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:39.833300 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-349b01ae-2b3a-464b-9ade-ebaa962296b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:39.839342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-349b01ae-2b3a-464b-9ade-ebaa962296b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:39.839819 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-349b01ae-2b3a-464b-9ade-ebaa962296b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:39.840589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-349b01ae-2b3a-464b-9ade-ebaa962296b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:39.841026 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-349b01ae-2b3a-464b-9ade-ebaa962296b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:39.871119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-349b01ae-2b3a-464b-9ade-ebaa962296b3 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043225 Jan 19 16:58:39.871593 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2054/2747] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:58:39 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:58:39.993704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-48c64b15-4225-44d6-89a2-71ff7875288e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:39.995241 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-48c64b15-4225-44d6-89a2-71ff7875288e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:40.001130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48c64b15-4225-44d6-89a2-71ff7875288e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:40.001769 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48c64b15-4225-44d6-89a2-71ff7875288e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:40.002538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48c64b15-4225-44d6-89a2-71ff7875288e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:40.005082 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-48c64b15-4225-44d6-89a2-71ff7875288e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:40.045392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-48c64b15-4225-44d6-89a2-71ff7875288e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056246 Jan 19 16:58:40.046331 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2055/2748] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 16:58:39 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 16:58:40.100848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:40.101345 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:40.107051 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:40.107500 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:40.108306 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:40.108739 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:40.134174 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:58:40.214256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-90560c67-84a2-4c0c-80d2-9e773cedbbbd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 204 len: 0 microversion: 2.1 time: 0.117414 Jan 19 16:58:40.214841 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2056/2749] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:58:40 2022] DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:58:40.223805 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:40.224804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:40.230994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:40.231450 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:40.232272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:40.232835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:40.373532 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:40.381044 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-255fe0bb-3cc8-4cc6-b7f5-cad27361ea45 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1674 microversion: 2.1 time: 0.161786 Jan 19 16:58:40.381677 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2057/2750] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:40 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:58:41.398953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:41.399742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:41.407318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:41.408053 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:41.410011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:41.411182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:41.728078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:41.738596 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-9ed5a610-024f-40ff-b805-58af15a1cb0d tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1674 microversion: 2.1 time: 0.343371 Jan 19 16:58:41.739388 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2058/2751] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:41 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1674 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:42.271951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-32e3d287-79b1-453e-b280-d50bfcc8a9bc req-776f97df-ddec-4c52-b193-62d4bea5248b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6d642e-934e-484f-91bb-ea63aa4a7ad9", "name": "network-vif-deleted", "tag": "8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:42.273559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:58:42.273559 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:58:42.291206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-32e3d287-79b1-453e-b280-d50bfcc8a9bc req-776f97df-ddec-4c52-b193-62d4bea5248b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:42.291773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-32e3d287-79b1-453e-b280-d50bfcc8a9bc req-776f97df-ddec-4c52-b193-62d4bea5248b service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:42.324995 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-32e3d287-79b1-453e-b280-d50bfcc8a9bc req-776f97df-ddec-4c52-b193-62d4bea5248b service nova] Creating event network-vif-deleted:8ed05fb1-2d7c-4a7c-9d15-d9b7ab7cf428 for instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 on hv-cinder-78447 Jan 19 16:58:42.331582 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-32e3d287-79b1-453e-b280-d50bfcc8a9bc req-776f97df-ddec-4c52-b193-62d4bea5248b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064348 Jan 19 16:58:42.332414 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2059/2752] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 16:58:42.756462 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:42.757250 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:42.771506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:42.773089 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:42.773848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:42.774297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:42.818282 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:42.818745 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:42.819252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lazy-loading 'fault' on Instance uuid ff6d642e-934e-484f-91bb-ea63aa4a7ad9 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:58:42.862592 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63c0a1b76904bf5b187743af7e96e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba3551993a4479e96ab741b8fe10555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:42.872418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-33337248-f29f-4159-a698-ebc281266e3f tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 200 len: 1328 microversion: 2.1 time: 0.120045 Jan 19 16:58:42.874094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2060/2753] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:42 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 16:58:43.391094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:43.391826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:43.399384 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:43.399879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:43.400721 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:43.403954 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:43.489840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'services' on Instance uuid 7c191150-ff10-4686-b24f-b589e8a89878 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:58:43.578274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-97e7c514-2339-407a-a93f-7c145bce407d tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878/os-volume_attachments/e6d61b3e-ffc3-40b8-8416-7bc0683c8dea" status: 202 len: 0 microversion: 2.1 time: 0.192161 Jan 19 16:58:43.578873 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2061/2754] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 16:58:43 2022] DELETE /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878/os-volume_attachments/e6d61b3e-ffc3-40b8-8416-7bc0683c8dea => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:58:43.890889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:43.891581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:43.897942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:43.898609 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:43.899636 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:43.900399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:43.915433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] HTTP exception thrown: Instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 could not be found. Jan 19 16:58:43.916057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Returning 404 to user: Instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:43.917247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-5e47c6aa-1a4c-4a8e-bb3e-ae3d63ab379a tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 404 len: 111 microversion: 2.1 time: 0.030520 Jan 19 16:58:43.917950 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2062/2755] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:43 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:58:43.926700 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-19384134-ef8c-49e2-a424-46e21e6e5bff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '.version_select at 0x7f716c128a60>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:43.951303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-19384134-ef8c-49e2-a424-46e21e6e5bff tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649463572" status: 202 len: 0 microversion: 2.1 time: 0.028650 Jan 19 16:58:43.951903 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2063/2756] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jan 19 16:58:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649463572 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 19 16:58:44.715914 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:44.716674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:44.723182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:44.723747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:44.724588 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:44.725203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:44.755290 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 16:58:44.846558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-13745d16-7975-4203-9e3e-1fb0add89348 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 204 len: 0 microversion: 2.1 time: 0.134281 Jan 19 16:58:44.847301 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2064/2757] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:58:44 2022] DELETE /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 16:58:44.856733 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:44.857539 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:44.872365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:44.873075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:44.873970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:44.874495 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:45.018348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:45.027469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0dd22a1e-f5d1-4ec5-a09d-ddfa33e413fa tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1512 microversion: 2.1 time: 0.175766 Jan 19 16:58:45.028086 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2065/2758] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:44 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:46.048738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:46.049407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:46.056487 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:46.056942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:46.057724 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:46.058171 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:46.187057 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:46.194383 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-42a63b9d-9234-4d8a-a51d-92fc19af2d2f tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1512 microversion: 2.1 time: 0.152269 Jan 19 16:58:46.194951 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2066/2759] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:46 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:47.211038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:47.211736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:47.219601 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:47.220083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:47.220866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:47.221308 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:47.355359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:47.362607 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-28b7ef3a-a042-4eae-bfa2-3f9629922aff tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1512 microversion: 2.1 time: 0.155222 Jan 19 16:58:47.363699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2067/2760] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:47 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:48.379810 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:48.380455 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:48.387127 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:48.387579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:48.388382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:48.388847 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:48.520808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:48.528496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7e8a679a-9453-4068-ba3a-86db1bf13bec tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1512 microversion: 2.1 time: 0.152893 Jan 19 16:58:48.529056 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2068/2761] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:48 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:49.545328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:49.546010 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:49.552094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:49.552545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:49.553313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:49.553748 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:49.686023 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:49.693432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-27338f87-e968-4dae-a748-6c0d7da359de tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1512 microversion: 2.1 time: 0.151798 Jan 19 16:58:49.694040 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2069/2762] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:49 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:50.512613 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-10ce02e4-88e2-469a-88a7-441112ad2ade req-626554b3-ea81-4fb3-bd3c-0be2e33dd747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c191150-ff10-4686-b24f-b589e8a89878", "name": "network-vif-deleted", "tag": "0ee48741-9e1f-464f-b036-53f99c8e4498"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 16:58:50.514358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 16:58:50.514358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 16:58:50.521961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-10ce02e4-88e2-469a-88a7-441112ad2ade req-626554b3-ea81-4fb3-bd3c-0be2e33dd747 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:50.522404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-10ce02e4-88e2-469a-88a7-441112ad2ade req-626554b3-ea81-4fb3-bd3c-0be2e33dd747 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:50.533501 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-10ce02e4-88e2-469a-88a7-441112ad2ade req-626554b3-ea81-4fb3-bd3c-0be2e33dd747 service nova] Creating event network-vif-deleted:0ee48741-9e1f-464f-b036-53f99c8e4498 for instance 7c191150-ff10-4686-b24f-b589e8a89878 on hv-cinder-78447 Jan 19 16:58:50.539631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-10ce02e4-88e2-469a-88a7-441112ad2ade req-626554b3-ea81-4fb3-bd3c-0be2e33dd747 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030545 Jan 19 16:58:50.540395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2070/2763] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 16:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 16:58:50.711071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:50.711878 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:50.718060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:50.718510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:50.719279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:50.719758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:50.750221 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:50.750669 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:50.751118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lazy-loading 'fault' on Instance uuid 7c191150-ff10-4686-b24f-b589e8a89878 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 16:58:50.790371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842191a2a2f94550aa4427649656ed38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2c73bd1cb4a0bb7fbb2b583473256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 16:58:50.797328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7663619a-af39-4005-81b8-9eb0c027a1df tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 200 len: 1309 microversion: 2.1 time: 0.090727 Jan 19 16:58:50.797888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2071/2764] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:50 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 16:58:51.814997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:51.815709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] [instance: 7c191150-ff10-4686-b24f-b589e8a89878] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:51.822514 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:51.823169 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:51.823973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:51.824407 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:51.837233 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] HTTP exception thrown: Instance 7c191150-ff10-4686-b24f-b589e8a89878 could not be found. Jan 19 16:58:51.837815 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] Returning 404 to user: Instance 7c191150-ff10-4686-b24f-b589e8a89878 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:51.838621 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-73537de5-8f84-4837-9c7e-3f3bdaad7cf9 tempest-VolumesSnapshotTestJSON-1973468951 tempest-VolumesSnapshotTestJSON-1973468951-project] 10.222.0.42 "GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878" status: 404 len: 111 microversion: 2.1 time: 0.027403 Jan 19 16:58:51.839180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2072/2765] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:51 2022] GET /compute/v2.1/servers/7c191150-ff10-4686-b24f-b589e8a89878 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:58:52.281266 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:52.281848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:52.287898 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:52.288889 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:52.289650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:52.290083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:52.303038 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] HTTP exception thrown: Instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 could not be found. Jan 19 16:58:52.303650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Returning 404 to user: Instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:52.304476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d3c9cb4c-7edd-4b66-bc32-4f1501e681dd tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 404 len: 111 microversion: 2.1 time: 0.026875 Jan 19 16:58:52.305307 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2073/2766] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:58:52 2022] DELETE /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:58:52.312272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:52.312871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: ff6d642e-934e-484f-91bb-ea63aa4a7ad9] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:52.318653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:52.319140 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:52.319918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:52.320354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:52.333999 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] HTTP exception thrown: Instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 could not be found. Jan 19 16:58:52.334577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Returning 404 to user: Instance ff6d642e-934e-484f-91bb-ea63aa4a7ad9 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:52.336052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-898c8fc1-341a-480a-9629-63d3baee791e tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9" status: 404 len: 111 microversion: 2.1 time: 0.027096 Jan 19 16:58:52.336581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2074/2767] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:52 2022] GET /compute/v2.1/servers/ff6d642e-934e-484f-91bb-ea63aa4a7ad9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:58:53.469698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:53.471141 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:53.478296 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:53.478747 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:53.479738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:53.480180 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:53.494516 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] HTTP exception thrown: Instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 could not be found. Jan 19 16:58:53.495116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Returning 404 to user: Instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:53.496244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-89fcb37a-be24-4bc1-9956-5cde51920976 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 404 len: 111 microversion: 2.1 time: 0.030182 Jan 19 16:58:53.496753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2075/2768] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 16:58:53 2022] DELETE /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 16:58:53.504818 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 16:58:53.505434 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] [instance: 06f71c7f-dd64-49e3-b9fe-5096584b8e66] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 16:58:53.514168 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:53.514630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:53.515478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 16:58:53.516164 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 16:58:53.529730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] HTTP exception thrown: Instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 could not be found. Jan 19 16:58:53.530465 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] Returning 404 to user: Instance 06f71c7f-dd64-49e3-b9fe-5096584b8e66 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 16:58:53.531411 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0c12e7f4-ae0d-4765-a767-6306a36bbde1 tempest-AttachVolumeTestJSON-1272346446 tempest-AttachVolumeTestJSON-1272346446-project] 10.222.0.42 "GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66" status: 404 len: 111 microversion: 2.1 time: 0.030267 Jan 19 16:58:53.532008 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2076/2769] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 16:58:53 2022] GET /compute/v2.1/servers/06f71c7f-dd64-49e3-b9fe-5096584b8e66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 19 16:59:26.165096 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:59:26.165593 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:59:52.101357 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:59:52.101927 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 16:59:52.594212 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 16:59:52.594460 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 16:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 17:00:38.064555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1215734679", "imageRef": "c6030134-7dba-4909-8798-c1b452ac89a3", "flavorRef": "452"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:00:38.112024 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] validate_networks() for None {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 17:00:38.371503 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 17:00:38.371963 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 17:00:38.372442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 17:00:38.372848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 17:00:38.373291 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 17:00:38.383152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:38.383600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:38.384433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:38.384871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:38.400558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Getting quotas for project 4fa848555c554439bcd1150c0cf998e0. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 17:00:38.404478 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Getting quotas for user 0ab3bc53792f4d22a64f6b67a43df1bf and project 4fa848555c554439bcd1150c0cf998e0. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 17:00:38.415182 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 17:00:38.417463 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6030134-7dba-4909-8798-c1b452ac89a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 17:00:38.459605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d6a72205-44bc-4c92-b6b0-9290840d05ae tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.400139 Jan 19 17:00:38.460439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2077/2770] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 17:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 17:00:38.470215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f9d4263d-d566-4dbe-8606-163daafa9d51 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:38.470820 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f9d4263d-d566-4dbe-8606-163daafa9d51 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:38.520070 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f9d4263d-d566-4dbe-8606-163daafa9d51 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:38.526631 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f9d4263d-d566-4dbe-8606-163daafa9d51 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1215 microversion: 2.1 time: 0.060449 Jan 19 17:00:38.527227 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2078/2771] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:38 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1215 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:39.543906 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:39.544556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:39.551571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:39.552069 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:39.552840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:39.553276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:39.611074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:39.618153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20aab1d3-9410-45c9-a307-2433676e6c36 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1219 microversion: 2.1 time: 0.077901 Jan 19 17:00:39.618703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2079/2772] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:39 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:40.635511 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:40.636220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:40.642936 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:40.643398 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:40.644207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:40.644654 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:40.708756 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:40.716789 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-18ebeea7-5977-43f2-b849-3d3cf5e8d53a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1219 microversion: 2.1 time: 0.084862 Jan 19 17:00:40.717846 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2080/2773] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:40 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:41.734900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:41.735561 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:41.741877 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:41.742325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:41.743094 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:41.743527 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:41.814410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:41.821993 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d122d24e-c280-4fb9-8fcc-f77376a4cd5b tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1273 microversion: 2.1 time: 0.091580 Jan 19 17:00:41.822869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2081/2774] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:41 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:42.626011 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-0cc894af-b058-41a4-b0d3-1e55319c2f84 req-f741381a-f483-4914-acf7-878a8b4a35f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec8ba61-2749-45cd-a452-af681d32ced6", "tag": "64c762f7-4896-426d-a1fc-c95a09e82e2d"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:00:42.627765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:00:42.627765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:00:42.635628 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-0cc894af-b058-41a4-b0d3-1e55319c2f84 req-f741381a-f483-4914-acf7-878a8b4a35f2 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:42.637632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-0cc894af-b058-41a4-b0d3-1e55319c2f84 req-f741381a-f483-4914-acf7-878a8b4a35f2 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:42.656130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-0cc894af-b058-41a4-b0d3-1e55319c2f84 req-f741381a-f483-4914-acf7-878a8b4a35f2 service nova] Creating event network-changed:64c762f7-4896-426d-a1fc-c95a09e82e2d for instance aec8ba61-2749-45cd-a452-af681d32ced6 on hv-cinder-78447 Jan 19 17:00:42.661682 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-0cc894af-b058-41a4-b0d3-1e55319c2f84 req-f741381a-f483-4914-acf7-878a8b4a35f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052604 Jan 19 17:00:42.663469 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2082/2775] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:00:42.838663 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:42.839449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:42.846254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:42.846716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:42.847571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:42.848111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:43.079449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:43.087129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-2dc72928-c42d-4154-b7a5-005ca086de6f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1315 microversion: 2.1 time: 0.252437 Jan 19 17:00:43.087972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2083/2776] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:42 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:44.104736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:44.105402 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:44.112213 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:44.112664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:44.113555 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:44.113994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:44.253804 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:44.260970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fdec75a0-6769-4301-8b4f-94083a17dc5a tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1315 microversion: 2.1 time: 0.159889 Jan 19 17:00:44.261524 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2084/2777] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:44 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:45.277392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:45.278093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:45.284513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:45.284972 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:45.285755 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:45.286199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:45.424930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:45.431989 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-92e05ac1-9c21-4f1f-b051-331fba0b1bd0 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1315 microversion: 2.1 time: 0.158192 Jan 19 17:00:45.432560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2085/2778] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:45 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:46.452845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:46.453557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:46.460157 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:46.460612 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:46.461390 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:46.461826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:46.591808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:46.599602 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f0004726-7344-4e7e-a001-d82b438dc381 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1315 microversion: 2.1 time: 0.150862 Jan 19 17:00:46.600196 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2086/2779] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:46 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 17:00:47.617255 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:47.618076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:47.625837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:47.626318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:47.627112 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:47.627541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:47.766479 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:47.775179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-84441154-8543-4f27-82d2-f441c0e0b5a7 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1315 microversion: 2.1 time: 0.162750 Jan 19 17:00:47.776668 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2087/2780] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:47 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:48.792692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:48.793381 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:48.799366 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:48.799881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:48.800671 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:48.801130 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:49.028894 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:49.047610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3340c3b9-2bbc-406c-86ea-5f7d9db0944f tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1315 microversion: 2.1 time: 0.258382 Jan 19 17:00:49.048786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2088/2781] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:48 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:49.385686 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-368e7659-1e8c-4a55-9cc0-442386a1e83a req-e50b9000-6706-43b9-be00-b5cb66d24353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec8ba61-2749-45cd-a452-af681d32ced6", "name": "network-vif-plugged", "status": "completed", "tag": "64c762f7-4896-426d-a1fc-c95a09e82e2d"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:00:49.387622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:00:49.387622 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:00:49.402353 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-368e7659-1e8c-4a55-9cc0-442386a1e83a req-e50b9000-6706-43b9-be00-b5cb66d24353 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:49.403151 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-368e7659-1e8c-4a55-9cc0-442386a1e83a req-e50b9000-6706-43b9-be00-b5cb66d24353 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:49.426548 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-368e7659-1e8c-4a55-9cc0-442386a1e83a req-e50b9000-6706-43b9-be00-b5cb66d24353 service nova] Creating event network-vif-plugged:64c762f7-4896-426d-a1fc-c95a09e82e2d for instance aec8ba61-2749-45cd-a452-af681d32ced6 on hv-cinder-78447 Jan 19 17:00:49.432798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-368e7659-1e8c-4a55-9cc0-442386a1e83a req-e50b9000-6706-43b9-be00-b5cb66d24353 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052071 Jan 19 17:00:49.435104 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2089/2782] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:00:50.065006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:50.065742 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:50.072885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:50.073504 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:50.074439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:50.074987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:50.256749 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:50.266165 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-edbc8834-9000-4132-8259-3920bf6b499c tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1315 microversion: 2.1 time: 0.205076 Jan 19 17:00:50.269763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2090/2783] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:50 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:51.283147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:51.284520 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:51.292222 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:51.293060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:51.294031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:51.294650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:51.478145 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:51.486667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ccf65622-f53b-416c-b611-0ef50e17ef17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1465 microversion: 2.1 time: 0.207582 Jan 19 17:00:51.487551 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2091/2784] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:51 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 17:00:51.525417 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:51.526731 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:51.548916 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:51.549391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:51.550273 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:51.551964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:51.577798 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 17:00:51.675924 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-59797a41-5c36-41e0-b95d-60d241396015 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 204 len: 0 microversion: 2.1 time: 0.153463 Jan 19 17:00:51.679452 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2092/2785] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 17:00:51 2022] DELETE /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 17:00:51.689926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:51.690538 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:51.698067 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:51.698608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:51.699510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:51.699901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:51.857348 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:51.865189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-511a68fb-3951-4e11-aeef-ab70b6714086 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1471 microversion: 2.1 time: 0.179804 Jan 19 17:00:51.865767 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2093/2786] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:51 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 17:00:52.883017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:52.884413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:52.893761 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:52.894200 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:52.895139 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:52.898653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:53.195546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:53.203116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b0ebea13-0957-4970-ab52-cf209de2da17 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1471 microversion: 2.1 time: 0.324399 Jan 19 17:00:53.203692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2094/2787] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:52 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:00:53.917438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-0ad7bcea-35db-4f2c-8f03-24baf3cad220 req-94a94f0c-3ed3-4d33-8cdd-0c04ff32fa51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec8ba61-2749-45cd-a452-af681d32ced6", "name": "network-vif-deleted", "tag": "64c762f7-4896-426d-a1fc-c95a09e82e2d"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:00:53.919258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:00:53.919258 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:00:53.939081 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-0ad7bcea-35db-4f2c-8f03-24baf3cad220 req-94a94f0c-3ed3-4d33-8cdd-0c04ff32fa51 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:53.939658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-0ad7bcea-35db-4f2c-8f03-24baf3cad220 req-94a94f0c-3ed3-4d33-8cdd-0c04ff32fa51 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:53.963956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-0ad7bcea-35db-4f2c-8f03-24baf3cad220 req-94a94f0c-3ed3-4d33-8cdd-0c04ff32fa51 service nova] Creating event network-vif-deleted:64c762f7-4896-426d-a1fc-c95a09e82e2d for instance aec8ba61-2749-45cd-a452-af681d32ced6 on hv-cinder-78447 Jan 19 17:00:53.971397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-0ad7bcea-35db-4f2c-8f03-24baf3cad220 req-94a94f0c-3ed3-4d33-8cdd-0c04ff32fa51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059585 Jan 19 17:00:53.972098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2095/2788] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 17:00:54.221573 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:54.222279 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:54.231449 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:54.240234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:54.241496 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:54.242153 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:54.297923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:54.298760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:54.299577 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lazy-loading 'fault' on Instance uuid aec8ba61-2749-45cd-a452-af681d32ced6 {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 17:00:54.364943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab3bc53792f4d22a64f6b67a43df1bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa848555c554439bcd1150c0cf998e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:00:54.375519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a10ec0e8-e522-4225-b55e-9d977fde00e8 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 200 len: 1305 microversion: 2.1 time: 0.158757 Jan 19 17:00:54.387557 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2096/2789] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:54 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 1305 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 17:00:55.392986 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:00:55.394738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] [instance: aec8ba61-2749-45cd-a452-af681d32ced6] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:00:55.404569 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:55.405048 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:55.407871 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:00:55.409059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:00:55.434885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] HTTP exception thrown: Instance aec8ba61-2749-45cd-a452-af681d32ced6 could not be found. Jan 19 17:00:55.437152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] Returning 404 to user: Instance aec8ba61-2749-45cd-a452-af681d32ced6 could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 17:00:55.439610 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a0de4e9f-c369-408a-9495-fe62f461f695 tempest-VolumesNegativeTest-1623906643 tempest-VolumesNegativeTest-1623906643-project] 10.222.0.42 "GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6" status: 404 len: 111 microversion: 2.1 time: 0.050440 Jan 19 17:00:55.440362 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2097/2790] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:00:55 2022] GET /compute/v2.1/servers/aec8ba61-2749-45cd-a452-af681d32ced6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 17:01:07.175664 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Action: 'create', calling method: .version_select at 0x7f716cd3f040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1297488685"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:07.189956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Getting quotas for project 582dd73fcf854c12a4044a39d967a9db. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 17:01:07.193771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Getting quotas for user 7bb69126fc8e4197bbaad959f0c358a2 and project 582dd73fcf854c12a4044a39d967a9db. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 17:01:07.206002 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [2ef5df74-aecd-4732-af09-590486fe80e5] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 19 17:01:08.214572 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [2ef5df74-aecd-4732-af09-590486fe80e5] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42306. Jan 19 17:01:08.511997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Getting quotas for project 582dd73fcf854c12a4044a39d967a9db. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 17:01:08.516118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Getting quotas for user 7bb69126fc8e4197bbaad959f0c358a2 and project 582dd73fcf854c12a4044a39d967a9db. Resources: {'key_pairs'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 17:01:08.529326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f0242a8-ecce-4eea-877d-3c0f1ee9a050 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.357468 Jan 19 17:01:08.529929 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2098/2791] 10.222.0.42 () {60 vars in 1157 bytes} [Wed Jan 19 17:01:07 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:08.620476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1606335439", "imageRef": "db7d2322-531b-4db3-b119-cb3a4ba93280", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1297488685", "networks": [{"uuid": "62ac357e-0df6-4332-8d04-f4e1de4152b4"}]}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:08.669256 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.network.neutron [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] validate_networks() for [('62ac357e-0df6-4332-8d04-f4e1de4152b4', None, None, None, None, None)] {{(pid=116210) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 19 17:01:09.025905 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Flavor limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 19 17:01:09.026337 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Image limits 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 19 17:01:09.026808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Flavor pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 19 17:01:09.027246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Image pref 0:0:0 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 19 17:01:09.027657 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.virt.hardware [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 19 17:01:09.036125 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:09.036581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:09.037646 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:09.038080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:09.054757 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Getting quotas for project 582dd73fcf854c12a4044a39d967a9db. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 19 17:01:09.058616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.quota [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Getting quotas for user 7bb69126fc8e4197bbaad959f0c358a2 and project 582dd73fcf854c12a4044a39d967a9db. Resources: {'ram', 'instances', 'cores'} {{(pid=116210) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 19 17:01:09.069676 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Going to run 1 instances... {{(pid=116210) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 19 17:01:09.071904 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db7d2322-531b-4db3-b119-cb3a4ba93280',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 19 17:01:09.118071 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0383797a-3172-4e9f-977d-a4e3ad227275 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501264 Jan 19 17:01:09.119054 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2099/2792] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jan 19 17:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 19 17:01:09.129098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-607ec83d-584a-4ad9-97fb-aae4848fb437 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:09.129711 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-607ec83d-584a-4ad9-97fb-aae4848fb437 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:09.182189 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-607ec83d-584a-4ad9-97fb-aae4848fb437 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:09.190525 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-607ec83d-584a-4ad9-97fb-aae4848fb437 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1259 microversion: 2.1 time: 0.064839 Jan 19 17:01:09.191095 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2100/2793] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:09 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:10.208854 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:10.209546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:10.217080 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:10.217776 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:10.218876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:10.219437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:10.312201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:10.319391 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-134d9fe5-2c69-4b03-aacf-3a792bf0d40c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1317 microversion: 2.1 time: 0.115286 Jan 19 17:01:10.319997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2101/2794] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:10 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:11.336147 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:11.336746 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:11.351935 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:11.352400 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:11.353207 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:11.353650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:11.514371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:11.521624 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-876a3992-1b62-4695-9bf1-38bea7bceaf2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.189149 Jan 19 17:01:11.522192 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2102/2795] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:11 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:12.538971 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:12.539606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:12.546616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:12.547068 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:12.547895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:12.548338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:12.703471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:12.711083 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-18ea1dbb-eed0-4cb5-bb6a-269afb4249b6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.175962 Jan 19 17:01:12.711967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2103/2796] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:12 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:13.728737 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:13.729375 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:13.736401 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:13.736859 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:13.737650 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:13.738093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:13.867327 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:13.874626 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ec256f8e-345d-4963-b93a-899347be8f97 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.149676 Jan 19 17:01:13.875185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2104/2797] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:13 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:14.897257 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:14.897892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:14.903930 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:14.904385 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:14.905177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:14.905617 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:15.288119 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:15.295387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b8b6b8d0-01cf-4202-a982-ecb9daca83f2 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.402261 Jan 19 17:01:15.295984 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2105/2798] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:14 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 17:01:16.311910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:16.312606 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:16.319286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:16.319868 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:16.320726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:16.321231 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:16.452190 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:16.459413 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-34238e52-e674-4ea2-a37b-590b6f7f75a8 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.151159 Jan 19 17:01:16.460016 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2106/2799] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:16 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:17.478981 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:17.480714 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:17.490087 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:17.490699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:17.491726 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:17.492249 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:17.657370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:17.664837 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b0c868e5-84f1-4355-8752-81bacb823fdb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.190843 Jan 19 17:01:17.665395 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2107/2800] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:17 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 17:01:18.682006 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:18.683432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:18.690519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:18.691052 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:18.691874 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:18.692325 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:18.817470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:18.824583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6afb16aa-ca37-42e2-aa34-3a8478ad2676 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.146387 Jan 19 17:01:18.825152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2108/2801] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:18 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:19.841075 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:19.841699 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:19.848540 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:19.848994 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:19.849770 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:19.850215 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:19.978096 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:19.985985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dff8a8dc-1732-4c64-9105-6a29a7083ac3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.148461 Jan 19 17:01:19.986653 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2109/2802] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:19 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:20.581519 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-3168ff95-6af2-46a9-b202-27bfdac25c36 req-ca446b80-3e91-4b1e-8c2c-2fff11112860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbc3984-9a7a-49e4-ae31-868a67441b0b", "tag": "38ea6388-08fd-46b6-b13f-75f9cdca1ded"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:20.583124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:01:20.583124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:01:20.597244 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-3168ff95-6af2-46a9-b202-27bfdac25c36 req-ca446b80-3e91-4b1e-8c2c-2fff11112860 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:20.597704 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-3168ff95-6af2-46a9-b202-27bfdac25c36 req-ca446b80-3e91-4b1e-8c2c-2fff11112860 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:20.611949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-3168ff95-6af2-46a9-b202-27bfdac25c36 req-ca446b80-3e91-4b1e-8c2c-2fff11112860 service nova] Creating event network-changed:38ea6388-08fd-46b6-b13f-75f9cdca1ded for instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b on hv-cinder-78447 Jan 19 17:01:20.617201 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-3168ff95-6af2-46a9-b202-27bfdac25c36 req-ca446b80-3e91-4b1e-8c2c-2fff11112860 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039312 Jan 19 17:01:20.617977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2110/2803] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:01:21.004629 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:21.005365 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:21.012334 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:21.012791 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:21.013736 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:21.014225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:21.462033 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:21.469687 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0d2b991b-b868-463a-af20-5a1f7c799e1f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.469833 Jan 19 17:01:21.470235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2111/2804] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:20 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:22.486060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:22.486703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:22.493185 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:22.493641 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:22.494426 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:22.494866 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:22.624766 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:22.634005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-87c8b97c-f919-4b99-819d-c64eb35393a3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.151514 Jan 19 17:01:22.634565 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2112/2805] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:22 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:23.651346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:23.651966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:23.658765 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:23.659218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:23.660031 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:23.660474 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:23.795063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:23.802272 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-44fa8351-ba2f-477f-b5d2-fa4c6bcd3c05 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.154697 Jan 19 17:01:23.802844 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2113/2806] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:23 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:24.819480 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:24.820113 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:24.826817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:24.827262 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:24.828049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:24.828477 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:24.954786 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:24.961892 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-3cea635b-a65f-43c7-a651-d446e1028ca6 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.146055 Jan 19 17:01:24.962459 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2114/2807] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:24 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:25.492059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-62d118fa-c756-42eb-88e0-08bd2b73e49e req-a7b00bb9-f2b2-48ed-8105-93ce557391b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbc3984-9a7a-49e4-ae31-868a67441b0b", "name": "network-vif-plugged", "status": "completed", "tag": "38ea6388-08fd-46b6-b13f-75f9cdca1ded"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:25.493600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:01:25.493600 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:01:25.502359 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-62d118fa-c756-42eb-88e0-08bd2b73e49e req-a7b00bb9-f2b2-48ed-8105-93ce557391b2 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:25.503471 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-62d118fa-c756-42eb-88e0-08bd2b73e49e req-a7b00bb9-f2b2-48ed-8105-93ce557391b2 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:25.514881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-62d118fa-c756-42eb-88e0-08bd2b73e49e req-a7b00bb9-f2b2-48ed-8105-93ce557391b2 service nova] Creating event network-vif-plugged:38ea6388-08fd-46b6-b13f-75f9cdca1ded for instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b on hv-cinder-78447 Jan 19 17:01:25.519541 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-62d118fa-c756-42eb-88e0-08bd2b73e49e req-a7b00bb9-f2b2-48ed-8105-93ce557391b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031582 Jan 19 17:01:25.520347 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2115/2808] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:01:25.979895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:25.980608 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:25.987392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:25.987985 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:25.988674 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:25.989118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:26.116138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:26.123315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4f8b6b20-c103-4653-bb0d-0cd5de905fbd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1359 microversion: 2.1 time: 0.147901 Jan 19 17:01:26.123900 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2116/2809] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:25 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:27.139940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:27.140679 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:27.146876 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.147278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.148114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.148558 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.280237 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:27.287758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-961139aa-0c13-4d35-807b-26c49c0c1842 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1549 microversion: 2.1 time: 0.151579 Jan 19 17:01:27.288326 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2117/2810] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:27 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:27.303633 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:27.304260 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:27.309658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.310111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.310885 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.311320 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.447851 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:27.455191 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-92e6d413-4d2c-453a-80f8-027499b17e28 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1549 microversion: 2.1 time: 0.154689 Jan 19 17:01:27.455869 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2118/2811] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:27 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:27.471560 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:27.474947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:01:27.474947 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:01:27.475977 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:27.476729 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Searching by: {'deleted': False, 'project_id': '582dd73fcf854c12a4044a39d967a9db'} {{(pid=116210) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 19 17:01:27.483966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.484423 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.485232 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.485706 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.572470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.multi_cell_list [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 19 17:01:27.666111 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6b250c99-6b3c-42a1-b36d-7982a8fed216 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197814 Jan 19 17:01:27.666698 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2119/2812] 10.222.0.42 () {58 vars in 1124 bytes} [Wed Jan 19 17:01:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:01:27.676354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:27.676967 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:27.682744 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.683194 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.684230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:27.684430 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:27.813078 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:27.820488 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-dd89b5ba-eff4-49d3-b5cf-6fdb0b0ff3e3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1549 microversion: 2.1 time: 0.147523 Jan 19 17:01:27.821234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2120/2813] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:27 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:29.299790 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-8b19f58b-8941-4ae5-aa2a-2a7d609bdc1d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4eb5592-686d-42fb-b9f2-5826e410c24d"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:29.301063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-8b19f58b-8941-4ae5-aa2a-2a7d609bdc1d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:29.309491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b19f58b-8941-4ae5-aa2a-2a7d609bdc1d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:29.310007 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b19f58b-8941-4ae5-aa2a-2a7d609bdc1d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:29.311387 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b19f58b-8941-4ae5-aa2a-2a7d609bdc1d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:29.311845 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-8b19f58b-8941-4ae5-aa2a-2a7d609bdc1d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:29.534358 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-8b19f58b-8941-4ae5-aa2a-2a7d609bdc1d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238108 Jan 19 17:01:29.534964 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2121/2814] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jan 19 17:01:29 2022] POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:01:35.980678 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:35.981364 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:35.987253 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:35.987723 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:35.988491 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:35.988922 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:36.115838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:36.123506 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-627324b7-737c-4b38-a4fb-662660ae1476 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1595 microversion: 2.1 time: 0.147189 Jan 19 17:01:36.124136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2122/2815] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:35 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1595 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:01:37.790763 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-59070541-6716-4e04-a3de-16f892a03cb0 req-5c8055a7-711d-44f6-b595-30dd1e4e1889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbc3984-9a7a-49e4-ae31-868a67441b0b", "tag": "38ea6388-08fd-46b6-b13f-75f9cdca1ded"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:37.792987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:01:37.792987 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:01:37.800410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-59070541-6716-4e04-a3de-16f892a03cb0 req-5c8055a7-711d-44f6-b595-30dd1e4e1889 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:37.800949 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-59070541-6716-4e04-a3de-16f892a03cb0 req-5c8055a7-711d-44f6-b595-30dd1e4e1889 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:37.815114 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-59070541-6716-4e04-a3de-16f892a03cb0 req-5c8055a7-711d-44f6-b595-30dd1e4e1889 service nova] Creating event network-changed:38ea6388-08fd-46b6-b13f-75f9cdca1ded for instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b on hv-cinder-78447 Jan 19 17:01:37.820199 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-59070541-6716-4e04-a3de-16f892a03cb0 req-5c8055a7-711d-44f6-b595-30dd1e4e1889 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033255 Jan 19 17:01:37.821015 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2123/2816] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 17:01:38.734918 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-485361913"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:38.735556 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:38.743332 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:38.744283 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:38.744597 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:38.745045 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:38.877909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.network.security_group_api [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Adding security group 1589f062-72e3-4d6c-a5cd-5a546c3d8da7 to port 38ea6388-08fd-46b6-b13f-75f9cdca1ded Jan 19 17:01:39.226380 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-a9f3b5c2-0ada-4729-bcb2-7bc74d0eb7d0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.499779 Jan 19 17:01:39.226997 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2124/2817] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 17:01:38 2022] POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 17:01:39.235468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:01:39.236123 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:01:39.242637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:39.243303 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:39.244118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:39.244730 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:39.419166 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:01:39.426842 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-7328a7bf-b572-4c45-b2df-1ef1de1acfcd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1760 microversion: 2.1 time: 0.195029 Jan 19 17:01:39.427490 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2125/2818] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:01:39 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 19 17:01:39.834311 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-c6d62626-215a-4ad8-9aaf-7fc0ebb83219 req-f7e27ad6-74af-467a-ae87-123a5d66d1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbc3984-9a7a-49e4-ae31-868a67441b0b", "tag": "38ea6388-08fd-46b6-b13f-75f9cdca1ded"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:01:39.835938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:01:39.835938 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:01:39.843955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-c6d62626-215a-4ad8-9aaf-7fc0ebb83219 req-f7e27ad6-74af-467a-ae87-123a5d66d1de service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:01:39.844410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-c6d62626-215a-4ad8-9aaf-7fc0ebb83219 req-f7e27ad6-74af-467a-ae87-123a5d66d1de service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:01:39.855143 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-c6d62626-215a-4ad8-9aaf-7fc0ebb83219 req-f7e27ad6-74af-467a-ae87-123a5d66d1de service nova] Creating event network-changed:38ea6388-08fd-46b6-b13f-75f9cdca1ded for instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b on hv-cinder-78447 Jan 19 17:01:39.860575 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-c6d62626-215a-4ad8-9aaf-7fc0ebb83219 req-f7e27ad6-74af-467a-ae87-123a5d66d1de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029736 Jan 19 17:01:39.861210 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2126/2819] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:02:01.722975 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6a9175ec-ce28-4029-abec-3f685b8554ff tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:02:01.724021 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6a9175ec-ce28-4029-abec-3f685b8554ff tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:01.730483 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a9175ec-ce28-4029-abec-3f685b8554ff tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:01.730927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a9175ec-ce28-4029-abec-3f685b8554ff tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:01.731696 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a9175ec-ce28-4029-abec-3f685b8554ff tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:01.732132 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6a9175ec-ce28-4029-abec-3f685b8554ff tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:01.799667 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6a9175ec-ce28-4029-abec-3f685b8554ff tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.080923 Jan 19 17:02:01.800342 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2127/2820] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 17:02:01 2022] POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 17:02:01.808432 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:01.809109 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:01.815101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:01.815550 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:01.816439 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:01.816910 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:02.051856 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:02.059632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-330d1a6a-10ce-4dde-aee0-6afc4f3eb2bb tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1752 microversion: 2.1 time: 0.255013 Jan 19 17:02:02.060235 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2128/2821] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:01 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1752 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:03.077957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:03.078585 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:03.085546 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:03.086005 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:03.086848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:03.087316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:03.225476 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:03.233179 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-86dd0c43-908b-428a-a515-e76938262611 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.158854 Jan 19 17:02:03.233751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2129/2822] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:03 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:04.250218 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:04.250895 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:04.257121 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:04.257570 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:04.258338 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:04.258774 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:04.402563 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:04.410716 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-825796da-60a7-49dc-b1ca-867d7b67a336 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.164132 Jan 19 17:02:04.411284 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2130/2823] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:04 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:05.427979 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:05.428594 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:05.434850 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:05.435302 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:05.436116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:05.436553 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:05.574371 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:05.582049 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-20daf70c-e3f7-462f-beaa-db1c30a413b0 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.157642 Jan 19 17:02:05.582616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2131/2824] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:05 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:06.598945 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:06.599605 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:06.605788 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:06.606239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:06.607004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:06.607444 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:06.751940 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:06.759522 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-b27c53be-ca4c-475c-bece-722d28c49a95 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.164187 Jan 19 17:02:06.760309 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2132/2825] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:06 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:07.776458 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:07.777060 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:07.783797 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:07.784243 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:07.785004 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:07.785433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:07.925177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:07.932760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c39945fa-8220-4a1e-b707-04d6c223e47b tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.159940 Jan 19 17:02:07.933392 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2133/2826] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:07 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:08.949410 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:08.950017 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:08.956953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:08.957405 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:08.958177 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:08.958616 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:09.107012 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:09.114702 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1259b1d4-b44b-4f04-a077-8be24c021451 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.168959 Jan 19 17:02:09.115269 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2134/2827] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:08 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:10.131219 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:10.131909 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:10.138133 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:10.138583 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:10.139346 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:10.139808 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:10.278328 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:10.286970 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-50ff102d-1298-4c9d-a9ba-49aa65f0b89c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.159083 Jan 19 17:02:10.287543 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2135/2828] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:10 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:11.305830 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:11.306468 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:11.313122 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:11.314230 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:11.314996 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:11.315433 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:11.453942 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:11.461515 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-39c4c5e1-c0fe-49e0-a605-837bae5f2d03 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.160515 Jan 19 17:02:11.462074 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2136/2829] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:11 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:12.478872 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:12.479510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:12.486289 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:12.486735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:12.487498 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:12.488030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:12.630063 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:12.637719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c72f0634-b4ea-42b2-a706-278cef5235ac tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.162474 Jan 19 17:02:12.638286 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2137/2830] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:12 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:13.654735 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:13.655324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:13.662120 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:13.662571 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:13.663382 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:13.663886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:13.803564 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:13.811278 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e0c4929b-2342-4796-8c0e-f172fb8ce6fd tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.160264 Jan 19 17:02:13.811870 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2138/2831] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:13 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:14.828712 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:14.829826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:14.835817 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:14.836267 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:14.837019 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:14.837448 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:14.979879 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:14.987579 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-f4f01311-24b5-4bf3-86ef-4515a188fa9a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.162520 Jan 19 17:02:14.988178 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2139/2832] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:14 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:16.004316 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:16.004943 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:16.011059 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:16.011508 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:16.012315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:16.012753 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:16.150203 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:16.158660 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-1d394c07-5c5d-4675-9145-4bb94f14474e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.157867 Jan 19 17:02:16.159276 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2140/2833] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:15 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:17.175656 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:17.176310 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:17.182803 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:17.183261 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:17.184076 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:17.184517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:17.324418 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:17.332835 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-09b095f8-0ef2-420a-ba0c-52f3846133fa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1757 microversion: 2.1 time: 0.160928 Jan 19 17:02:17.333406 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2141/2834] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:17 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:18.349619 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:18.350264 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:18.356510 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:18.356953 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:18.357708 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:18.358138 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:18.500397 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:18.508709 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-fa4b26ad-7db7-45f1-bbef-be5e587be97e tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1760 microversion: 2.1 time: 0.162741 Jan 19 17:02:18.509275 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2142/2835] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:18 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:46.172990 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:02:46.173592 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 17:02:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 17:02:50.849738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-485361913"}} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:02:50.850826 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:50.856799 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:50.857246 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:50.857998 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:50.858425 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:50.983862 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.network.security_group_api [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Removing security group 1589f062-72e3-4d6c-a5cd-5a546c3d8da7 from port 38ea6388-08fd-46b6-b13f-75f9cdca1ded Jan 19 17:02:51.310758 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-4d0c6d27-e193-4aa7-b65f-06d47d81e7aa tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.464706 Jan 19 17:02:51.314394 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2143/2836] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jan 19 17:02:50 2022] POST /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 17:02:51.318247 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-c7271acd-8bb1-44f7-9e23-2f11a6ba431a req-8587a9f6-1de5-4c91-8849-dd41ba39823f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbc3984-9a7a-49e4-ae31-868a67441b0b", "tag": "38ea6388-08fd-46b6-b13f-75f9cdca1ded"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:02:51.323014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:02:51.323014 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:02:51.330957 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-c7271acd-8bb1-44f7-9e23-2f11a6ba431a req-8587a9f6-1de5-4c91-8849-dd41ba39823f service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:51.331923 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-c7271acd-8bb1-44f7-9e23-2f11a6ba431a req-8587a9f6-1de5-4c91-8849-dd41ba39823f service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:51.345893 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-c7271acd-8bb1-44f7-9e23-2f11a6ba431a req-8587a9f6-1de5-4c91-8849-dd41ba39823f service nova] Creating event network-changed:38ea6388-08fd-46b6-b13f-75f9cdca1ded for instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b on hv-cinder-78447 Jan 19 17:02:51.351545 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-c7271acd-8bb1-44f7-9e23-2f11a6ba431a req-8587a9f6-1de5-4c91-8849-dd41ba39823f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 Jan 19 17:02:51.352632 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2144/2837] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 19 17:02:52.662640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:52.663208 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:52.675848 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:52.676517 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:52.677312 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:52.677901 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:52.755152 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lazy-loading 'services' on Instance uuid 2dbc3984-9a7a-49e4-ae31-868a67441b0b {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 17:02:52.822955 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-902ee710-8236-41d7-ae91-1d9e5405cc4f tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments/a4eb5592-686d-42fb-b9f2-5826e410c24d" status: 202 len: 0 microversion: 2.1 time: 0.165037 Jan 19 17:02:52.823581 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2145/2838] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 17:02:52 2022] DELETE /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments/a4eb5592-686d-42fb-b9f2-5826e410c24d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 17:02:52.832037 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-efd31b2d-c0a0-488f-aaf2-fd5282df6b2a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:52.833093 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-efd31b2d-c0a0-488f-aaf2-fd5282df6b2a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:52.839505 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efd31b2d-c0a0-488f-aaf2-fd5282df6b2a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:52.840160 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efd31b2d-c0a0-488f-aaf2-fd5282df6b2a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:52.841042 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efd31b2d-c0a0-488f-aaf2-fd5282df6b2a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:52.841482 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-efd31b2d-c0a0-488f-aaf2-fd5282df6b2a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:52.873129 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-efd31b2d-c0a0-488f-aaf2-fd5282df6b2a tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Jan 19 17:02:52.873692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2146/2839] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 17:02:52 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:02:53.375881 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-da5dd47d-c4aa-41a5-a3f5-440802bf0068 req-f8b89320-f5f8-490e-b990-546522b73a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbc3984-9a7a-49e4-ae31-868a67441b0b", "tag": "38ea6388-08fd-46b6-b13f-75f9cdca1ded"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:02:53.377554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:02:53.377554 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:02:53.384771 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-da5dd47d-c4aa-41a5-a3f5-440802bf0068 req-f8b89320-f5f8-490e-b990-546522b73a89 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:53.385216 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-da5dd47d-c4aa-41a5-a3f5-440802bf0068 req-f8b89320-f5f8-490e-b990-546522b73a89 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:53.396000 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-da5dd47d-c4aa-41a5-a3f5-440802bf0068 req-f8b89320-f5f8-490e-b990-546522b73a89 service nova] Creating event network-changed:38ea6388-08fd-46b6-b13f-75f9cdca1ded for instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b on hv-cinder-78447 Jan 19 17:02:53.401973 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-da5dd47d-c4aa-41a5-a3f5-440802bf0068 req-f8b89320-f5f8-490e-b990-546522b73a89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029435 Jan 19 17:02:53.402589 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2147/2840] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:02:53.885703 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-603e3a36-6d18-4e1f-a0b5-7b45e1e10694 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:53.886640 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-603e3a36-6d18-4e1f-a0b5-7b45e1e10694 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:53.892666 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-603e3a36-6d18-4e1f-a0b5-7b45e1e10694 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:53.893118 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-603e3a36-6d18-4e1f-a0b5-7b45e1e10694 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:53.893888 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-603e3a36-6d18-4e1f-a0b5-7b45e1e10694 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:53.894330 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-603e3a36-6d18-4e1f-a0b5-7b45e1e10694 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:53.925136 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-603e3a36-6d18-4e1f-a0b5-7b45e1e10694 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044045 Jan 19 17:02:53.925692 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2148/2841] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jan 19 17:02:53 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 19 17:02:53.934760 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:53.935248 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:53.940672 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:53.941124 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:53.941884 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:53.942318 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:54.011802 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] HTTP exception thrown: Instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b is not attached to volume a4eb5592-686d-42fb-b9f2-5826e410c24d Jan 19 17:02:54.012404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Returning 404 to user: Instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b is not attached to volume a4eb5592-686d-42fb-b9f2-5826e410c24d {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 17:02:54.013220 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-0ef41c79-11a2-4e66-b4e9-5596f77cd39c tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments/a4eb5592-686d-42fb-b9f2-5826e410c24d" status: 404 len: 154 microversion: 2.1 time: 0.081865 Jan 19 17:02:54.013751 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2149/2842] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jan 19 17:02:53 2022] DELETE /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b/os-volume_attachments/a4eb5592-686d-42fb-b9f2-5826e410c24d => generated 154 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 17:02:55.137643 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:55.138193 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:55.144437 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:55.144886 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:55.145658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:55.146098 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:55.171229 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Going to try to terminate instance {{(pid=116210) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 19 17:02:55.241523 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-e7679899-9683-4af5-97a8-3646636cbd09 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 204 len: 0 microversion: 2.1 time: 0.107060 Jan 19 17:02:55.242184 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2150/2843] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jan 19 17:02:55 2022] DELETE /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 19 17:02:55.251314 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:55.252030 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:55.257719 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:55.258163 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:55.258926 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:55.259363 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:55.389254 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:55.396399 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-79166f43-682e-4493-ba74-a4c47e1a7c45 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1555 microversion: 2.1 time: 0.148893 Jan 19 17:02:55.397473 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2151/2844] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:55 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:56.414274 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:56.414927 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:56.421187 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:56.421637 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:56.422404 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:56.422840 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:56.801370 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:56.808773 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-6aefde84-60fa-4c7f-a06e-114e741f6ac9 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1555 microversion: 2.1 time: 0.398854 Jan 19 17:02:56.809354 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2152/2845] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:56 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1555 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:57.364206 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [req-127e4f26-7651-46cb-ad32-a772b198113e req-da852cd4-e7d1-4480-9f87-eb1a5430c761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbc3984-9a7a-49e4-ae31-868a67441b0b", "name": "network-vif-deleted", "tag": "38ea6388-08fd-46b6-b13f-75f9cdca1ded"}]} {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 19 17:02:57.366239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 19 17:02:57.366239 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: warnings.warn(msg) Jan 19 17:02:57.373195 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-127e4f26-7651-46cb-ad32-a772b198113e req-da852cd4-e7d1-4480-9f87-eb1a5430c761 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:57.373647 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [req-127e4f26-7651-46cb-ad32-a772b198113e req-da852cd4-e7d1-4480-9f87-eb1a5430c761 service nova] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:57.385116 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.compute.server_external_events [req-127e4f26-7651-46cb-ad32-a772b198113e req-da852cd4-e7d1-4480-9f87-eb1a5430c761 service nova] Creating event network-vif-deleted:38ea6388-08fd-46b6-b13f-75f9cdca1ded for instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b on hv-cinder-78447 Jan 19 17:02:57.389961 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [req-127e4f26-7651-46cb-ad32-a772b198113e req-da852cd4-e7d1-4480-9f87-eb1a5430c761 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029359 Jan 19 17:02:57.390630 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2153/2846] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jan 19 17:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 19 17:02:57.826590 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:57.827297 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:57.833442 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:57.833899 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:57.834792 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:57.835234 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:57.881470 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:57.882134 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:57.882738 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.objects.instance [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lazy-loading 'fault' on Instance uuid 2dbc3984-9a7a-49e4-ae31-868a67441b0b {{(pid=116210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 19 17:02:57.929101 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.policy [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb69126fc8e4197bbaad959f0c358a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582dd73fcf854c12a4044a39d967a9db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116210) authorize /opt/stack/nova/nova/policy.py:199}} Jan 19 17:02:57.935966 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-ae3b13ae-24a7-4430-9497-b4c68e99b131 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 200 len: 1349 microversion: 2.1 time: 0.113684 Jan 19 17:02:57.936536 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2154/2847] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:57 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 1349 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 19 17:02:58.952875 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:58.953513 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.compute.api [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] [instance: 2dbc3984-9a7a-49e4-ae31-868a67441b0b] Fetching instance by UUID {{(pid=116210) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 19 17:02:58.959795 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:58.960252 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:58.961027 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 19 17:02:58.961467 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG oslo_concurrency.lockutils [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Lock "64672888-0d64-4da8-bffb-e5ab20f1eacc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 19 17:02:58.975952 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.wsgi [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] HTTP exception thrown: Instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b could not be found. Jan 19 17:02:58.976530 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Returning 404 to user: Instance 2dbc3984-9a7a-49e4-ae31-868a67441b0b could not be found. {{(pid=116210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 19 17:02:58.977324 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-c0a5464b-6a6c-4409-91dd-bf89873afa4d tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b" status: 404 len: 111 microversion: 2.1 time: 0.028210 Jan 19 17:02:58.977838 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2155/2848] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jan 19 17:02:58 2022] GET /compute/v2.1/servers/2dbc3984-9a7a-49e4-ae31-868a67441b0b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 19 17:02:58.984956 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: DEBUG nova.api.openstack.wsgi [None req-d54b5f2b-d494-4eef-b88d-70cf8f1b5bf3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] Calling method '.version_select at 0x7f716fb8bc10>' {{(pid=116210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 19 17:02:59.001313 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO nova.api.openstack.requestlog [None req-d54b5f2b-d494-4eef-b88d-70cf8f1b5bf3 tempest-TestMinimumBasicScenario-1908319027 tempest-TestMinimumBasicScenario-1908319027-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1297488685" status: 202 len: 0 microversion: 2.1 time: 0.019463 Jan 19 17:02:59.001827 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: [pid: 116210|app: 0|req: 2156/2849] 10.222.0.42 () {58 vars in 1271 bytes} [Wed Jan 19 17:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1297488685 => generated 0 bytes in 20 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 19 17:03:12.112484 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:03:12.113047 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 17:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 17:03:12.603125 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:03:12.603319 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 17:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 17:04:28.439658 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:04:28.440225 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 17:04:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 17:06:06.180985 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:06:06.181573 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 17:06:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 17:06:32.120381 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:06:32.121101 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 17:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 17:06:32.611597 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:06:32.611824 dv-cinder-784477-14-iscsi devstack@n-api.service[116209]: Wed Jan 19 17:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/805b0677-e780-415d-8ce6-ca4ec1a0817a (ip 10.222.0.42) !!! Jan 19 17:07:48.447438 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:07:48.448065 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 17:07:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 17:08:01.432492 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:08:01.433170 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 17:08:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 19 17:08:10.016777 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 19 17:08:10.017315 dv-cinder-784477-14-iscsi devstack@n-api.service[116210]: Wed Jan 19 17:08:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!